Input-Output 
Analysis in Public 
Education 


“Ee 
Input-Output 
Analysis in Public 
Education 


Elchanan Cohn 
University of South Carolina 


With 

Stephen D. Millman 
Maryland State Board for 
Community Colleges 


And a Contribution by 
It-Keong Chew 
University of South Carolina 


Ballinger Publishing Company € Cambridge, Mass. 
A Subsidiary of J.B. Lippincott Company 


S.C.E R T.. Wes: Bengal 
Data 7, 5, 94- 


Acc. No.2464 и 


This book is printed on recycled paper. 


Copyright € 1975 by Ballinger Publishing Company. AII rights reserved, No part 
of this publication may be reproduced, stored in a retireval system, or trans- 
mitted in any form or by any means, electronic mechanical photocopy, 


recording 
or otherwise, without the prior written consent of the publisher. 


International Standard Book Number: 0-88410-155-X 


Library of Congress Catalog Card Number: 75-19249 


Printed in the United States of America an 


Library of Congress Cataloging in Publication Data 


Cohn, Elchanan. 
Input-Output analysis in public education. 
Bibliography: p. 
Includes index. 


1. Education—United States—Finance. 2. Education—United States—Costs. 
І. Millman, Stephen D., joint author. II. Chew, It-Keong, joint author. Ш. 
Title. 


LB2825.C584 


379712170973 75-19249 
ISBN 0-88410-155-Х 


ран 


To Sharon, David, and Klara 


Contents 


List of Figures and Tables xi 


xiii 
Preface 


Chapter One 


The Assessment of Educational Effectiveness 1 
А Summary of Approaches to Educational Assessments ; 
Input-Output Studies 

Chapter Two | р 

Input-Output Analyses: А New Perspective for Education 9 
The Emergence of Input-Output Studies: A Systems Perspective ш 
Systems Theory 4 | 
Input-Output Techniques as a Management Tool in Education 13 

Chapter Three " 

Production Functions in Secondary Schools 
Inputs fs 
Outputs a 
The Input-Output Process He 


Concluding Comments 


Chapter Four 22 
Input-Output Analysis in the Development of an Educationa 


Production Function for Elementary and Secondary Schools 29 


vii 


viii Contents 


The Input-Output Studies: A Survey 
Where Do We Stand Now? 
Concluding Comments 


Chapter Five 
The Pennsylvania Plan 


Purposes of the Plan 

The Ten Goals of Quality Education 
Data Collection 

Administration 

Concluding Comments 


Chapter Six 
Production Functions for Pennsylvania Secondary Schools 


The Data 

The Model 

Regression Results 

Applications of the Simultaneous-Equations Results 
Concluding Comments 


Chapter Seven 

An Output Index: Canonical Correlations 
Canonical Correlations 
Output Indexes 


Applications Involving the Output Index 
Concluding Comments 


Chapter Eight 
Mathematical Programming: An Alternative Input-Output Tool 


Linear and Goal Programming: An Introduction 


Goal Programming in Educational Input-Output Analysis 
Concluding Comments 


31 


46 


57 


57 
58 
64 
76 
79 


81 


81 
82 
86 
90 


91 


92 
95 
97 


Contents ix 


Appendix Tables 99 
Glossary M 
Bibliography 125 
Index 19 

137 


About the Authors 


List of Figures and Tables 


Figure 


3-1 


Total Product Curve and Linear Approximations 


The Approaches to Assessment of Educational Effectiveness 

A Planning-Programming-Budgeting Scheme 

Major Input-Output Studies by Primary Level of Data Aggregation 
Major Input-Output Studies by Primary Method of Analysis 
Utilized 

Summary Chart of Effectiveness Studies on School Service 
Components 

Pennsylvania's Ten Goals of Quality Education 

EQA Samples, 1970 to 1973 

Output Variables: Definitions, Means, and Standard Deviations 
Input Variables: Definitions, Means, and Standard Deviations 
Simultaneous-Equations Model 

Variables Included in the Four Socioeconomic Factors 
Production Function Estimates for Manipulative Inputs—Goal I 
Production Function Estimates for Manipulative Inputs—Goal II 
Production Function Estimates for Manipulative Inputs—Goal 
III-v 

Production Function Estimates for Manipulative Inputs—Goal 
III-m 

Production Function Estimates for Manipulative Inputs—Goal IV 


xi 


26 


xii List of Figures and Tables 


Production Function Estimates for Manipulative Inputs—Goal V 
Production Function Estimates for Manipulative Inputs—Goal VI 
Production Function Estimates for Manipulative Inputs—Goal 
УП-р 

Production Function Estimates for Manipulative Inputs—Goal 
УП-о 

Production Function Estimates for Manipulative Inputs—Goal VIII 
Production Function Estimates for Manipulative Inputs—Goal IX 
Production Function Estimates for Manipulative Inputs—Goal X 
Input and Output Variables Included in the Canonical Correlation 
Analyses 

Normalized Canonical Weights for Various Input-Output Sets 
Calculation of an Output Index: An Illustration for “School А” 
Zero Order Correlation Coefficients for Output Indexes 
Regression Results for Economies of Scale Model 

Regression Results for Teacher Characteristics Model 

Dimensions and Measurement of the EQA Goals (Grade 11) 

EQA School and Community Inputs 

Instructional Staff Inputs 

Additional Inputs 


Production Function Estimates for Pennsylvania Secondary 
Schools 


Preface 


There is increasing awareness of the need to apply rigorous management tech- 
niques to assist education decision makers in allocating scarce resources. The 
need for greater educational productivity has been placed into a sharper focus by 
the fiscal problems confronting education. The basic reason for such fiscal prob- 
lems has been the ever-increasing costs of education—despite a reduction in the 
rate of increase in enrollments and, in some cases, an absolute decrease in enroll- 
ments—which are related to higher input costs despite little or no improvement 
in educational productivity. When costs increase but productivity remains essen- 
tially constant, costs per unit of output must increase, and therefore schools 
must seek increased public support. In an effort to reduce the burden of govern- 
ment operations, economy minded legislatures and boards of education are re- 
luctant to increase tax revenues in proportion to the increase in educational 
costs. Something, therefore, must “give.” Either the level of production must 
decrease, or ways must be found to produce the same output from a smaller 
input base. 

The assumption underlying this study is that there exist some possible ways 
to reduce input costs without reducing the level of educational output—or, alter- 
natively, to produce a greater level of output utilizing the same amount of in- 
puts. This means, of course, that management decisions in education have not 
been optimal. This is not to say that educational administrators have necessarily 
been lax, but rather that the nature of educational production is so complex 
that even the best administrators would be unable to arrive at the optimal de- 
cision. 

The study therefore explores some techniques that could assist education 
managers in their attempt to arrive at more optimal input and output mixes. 


xiii 


xiv Preface 


No panacea is offered here; only suggestions that would require thoughtful and 
searching analysis along with serious data collection are proposed. 

The first part of this study consists of Chapters One through Four, which 
provide an overview of the input-output concept in relation to its employment 
in the educational setting, along with a review of the literature on the educa- 
tional production function. The second part explores the production process 
of secondary education for a sample of Pennsylvania secondary schools. A de- 
scription of the Pennsylvania Plan is contained in Chapter Five, followed by a 
simultaneous-equations analysis in Chapter Six and the construction of an out- 
put index, based upon the technique of canonical correlations, in Chapter Seven. 
The final part consists of a brief chapter on the use of mathematical program- 
ming, in particular goal programming, as an alternative tool for educational 
input-output analysis. 

Although I must assume full responsibility for the entire work, primary re- 
sponsibility for Chapters One, Two, and Four was shouldered by Dr. Stephen 
Millman, and Chapter Eight was contributed by Mr. It-Keong Chew. 

This study evolved from a doctoral dissertation completed by Dr. Rodney J. 
Kuhns at the Pennsylvania State University in 1972. The data used here were 
compiled by Dr. Kuhns, in cooperation with the Pennsylvania Department of 
Education, and single equation analysis was reported in Kuhns's dissertation 
(1972). The work presented in Chapters Six and Seven is an extension of his 
work, providing for the first time a comprehensive simultaneous-equations sys- 
tem describing educational production in a secondary school system. Our ability 
to conduct the study was conditioned on the coopreation of Dr. Kuhns and 
officials of the Pennsylvania Department of Education, to whom we are very 
grateful. 

An earlier version of the Pennsylvania model is contained in a final report to 
the National Institute of Education, entitled "Management-Oriented Approaches 
to Assess Input-Output Relationships in Secondary Schools." I am grateful to 
the National Institute of Education for financial Support and to the staff of the 
Institute for Research on Human Resources, The Pennsylvania State University 
(where the study was conducted) for competent cooperation. 

I would also like to thank without implicating my former colleague Teh-wei 
Hu for reading an early version of the manuscript. Special thanks are due to 
Michael J. Foxworth and Lloyd R. Drown, of the Management Science Center, 
College of Business Administration, University of South Carolina, for performing 


intricate programming and computer analysis to derive the set of reduced-form 
coefficients and their respective asym: 


ptotic standard errors, reported in Chapter 
6 and Appendix Table A- 


5. Others who aided in the production of the manu- 
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Script at the University of South Carolina include Harry Miley, Charles Melton, 


and Cathy Price. 
I would be remiss if I did not thank my wife, Sharon, not only for her pa- 


tience and understanding during the long hours it took to produce this work but 
also for reading, proofing, and commenting on every chapter of this book, and 
helping in the preparation of the Index. 


Elchanan Cohn 
Columbia, South Carolina 
May, 1975 
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The Assessment of 
Educational Effectiveness 


Great ferment is currently evident in discussions of new directions for the 
schools and for the selection, retention, and reward structure of those who will 
carry out these new directions. For the first time, individuals are attempting to 
Specify aspects of the educational process in terms of actual outcomes of those 
Who exit the system vis-d-vis the resources that are used as inputs into the sys- 
tem. The stress on performance criteria and behavioral competencies bodes well 
to overturn past emphasis on time spent in school, summation of credit hours, 
and the like. D. 
Clearly, such an approach is а radical departure from past functioning, and 
the road ahead is still not totally visible to the interested viewer. Despite the un- 
certainty, current acceptance of the need for movement toward competency- 
based education indicates at long last that many are willing to advance the 
ability to quantify the nature of the educational process in terms of the flow of 
energy through the system vis-à-vis the output. We have mE to see that the 
traditional academic bookkeeping has failed to give us any idea of what has 
entered, what has been transformed, and what has emerged. We have talked in 
terms of global objectives seldom amenable to measurement—or even, in some 
cases, definition. 
Economists have for some time been vitally interested in the flow of re- 
Sources through organizations and institutions of various kinds. While those 
Outside economics have visualized the economist as concerned only with the 
flow of money units, economists themselves have been studying resqurces of all 
kinds—products, information, and human resources. The new directions in edu- 
cation in many ways represent application of principles that economists have 


developed. 
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More than any other single factor, what has become known as the p 
emphasis on "educational accountability" has forced educators to view x 
educational process anew from the perspective of efficient use of resource - 
transforming the variety of exogenous and endogenous inputs into a set 0 
socially desired outputs. The tools of the economist, more than those of any 
other discipline, appear to offer the most promise in the current context. 

The focus of this chapter is upon specification of the various extant models 
for analysis of the educational process. Following discussion of the models, 
attention is directed to an in-depth delineation of the origin, value, and uses of 


i Мір А —the 
the economist's main contribution to assessment of educational impact 
so-called "input-output approach." 


A SUMMAR Y OF APPROACHES TO 
EDUCATIONAL ASSESSMENTS 


Any broad categorization of 


diverse theoretical orientations from separate and 
largely discrete disciplines is 


necessarily somewhat arbitrary, and the scheme 


the criteria used for organization are those by 
which we would evaluate any specific theory. Specifically, we have asked of this 


typology: Is it inclusive? Is it consistent? Is it valuable heuristically? Is it parsi- 
monious? In contrast to certain existing schemata, we believe the present ap- 
to all these queries. 


The Assessment of Educational Effectiveness 3 


> RR 


apeu oq p[noo зец] 


'Зшхеш џогтоор Aod ој o[q. suorstoop Аоцод Jo 129119 әш) 


-I1jdoosns ?jep porjuenb Әшрілога 
10 a[qedeo ssooo1d үвиопвопрә 
олпио JO мог [830] ISOU зормоја 


‘AQUOUL pads [erjuejsqns so1mb 
-93 гројиошојаш! sasueyo ше18 
-01d јепритрш jo s122JJ2 ә}р1рЧә$ 
Əy} ошшлојор о) упоцир иојо 


suorjeoridurt 

Аэцой syru езер oAnvjrjuenb jo 
Хор] “sIOULIOJaI үеиоцвопрә әц Aq 
Á[uo роцојеш pejop јејорјзоше Jo 
5$әицә!1 v soprAo1d цоволаде opa 


әдиецо [euorjon sur 10feur 

10j suor eorpdurr Aorpod zueyodun 
ӘЛЕЦ 0] ,O2JOIUI,, 00] UD]JO AIL 
sotpnis "ролојашо so1npoooud ш 
juo1edde st 10311 цопш uSnouy 


‘suoIsioap оцой o} o[qeuoure 

10 pojeor[do1 Ajisea jou ‘sainpas 
-01d |в иәшітәйхә 10 |Р21511815 ou 
dulsn "ОЈ ЕЈ 1504 xo 51 yoroiddy 


ӘҮЕІП ШІ5 О} зоја ІРЛ ӘШОО 
-}no pue oo1nosor o[dr [nur 
Jo uone[nditueur jeonseis 


Joquinu 

рәш uey} лоше syndur 
Auew әЗирцә Apuoururo;) 
'sjuopnis Jo [9A9[ JJS 10 
101АРЦӘД oouonjjur ој 1duioj 
“18 'soo1noso1 [puorjrppe 

JO вәзор әліззеш us3no1u L 


pərjdde st роцјош 
Ápnis aseo 'Атјелоџосу 


әЗирцо [e1orA?uoq зиәр 
-115 UO JUDUN RAT} јејџош 
“од Хо Јо 1әәјјә Тепрілір 
-Ut ошшлојор о) јашојје 
чопејташеш з родио? 
Іејчәші1әйхә јо osn Ag 


uonoo[oi *uoreurumi 
'uoneAiosqo зират}: 


Цо1рәвә1, od Á]-ueulo[0)),, 
sorpnjs 

559 пол 09112-1505) 
uonounj 

uoronpoid попеопра 

yoroidde surojsAg 


yorrasal 
Jo ad} j1e\speoyy 


10 (VASA) I INIL 


ЧОПР?ЦРІОО6 
зооиопуш Аџипшшод5 


sdno1i$3 Surute1[ 

џопеоштрош ломецод 
suruornpuoo 

juepuodso1 эў juv1odQ 


uonvonpo 
([Eotp?1) SAI} eUIAITY 
иоцтопрә 
(»nsrugeumu) јепџоподха 
uor] eonpo ш 515112) 


JOUAIS }пәшәЗрирр 
sorurouoo 


sorpnis Aotjod uonronpy 


1отлецод ТРИОПР МЕЗІ) 
BOUDIOS |РоПЦОдД 
К8ој012056 


UOISIAIadns % шттпошт) 


уошотвош эў Sutjso [, 


АвојоцоАва јео шшодх а 


AdojoyoAsd jeuoneonpy 


uoneonpo јо 


ѕиоцерипој [e1nj[n;) 
Aydosojtyd jeuorjeonpq 


$әїрп1$ jndjno-jnduy 


SUOTJUDAIO}UI 
10[еш jo sisA[pu v 


yovoidde 1/27520) 
[£1nj[no-[e190S8 


Цотеә5әі 
А1оәтр Sutuleay 


шіоуәі јеџоцеопроа 
Jo әїп)в1ә}] ou 


MR жаны P RN нанын a a 


S2ua3uttuo;) 


рә4огашл «рагшојто 


(30]opoiI2]y 1240352] 


P21D190SSY диошшо> 
Sp40M day 


рәтіооввр (Јиошшо? 
1/21// 1/1 S2uidiosi(] 


yəvoiddy 


M MCCC ME са ы ЕНЕ dio ee сыын 


Ssəuəa!79ə4}47 Іеиотзрәпрэ jo зиәшѕѕәѕѕүу 0} saydeouddy ayy “1-1 әде 


4 Input-Output Analysis in Public Education 


educational reforms discussed above, argue for their specific recommendations 
a priori rather than from the basis of hard data generated and analyzed. The 
stress is upon subjective judgment. Such a bent cannot be denied out of hand; 
however, the approach makes replication and consequent checks of validity and 
reliability difficult, if not impossible. Implications of such "soft" analysis are 
thus not directly amenable to making an effect on policy decisions in any global 
sense. Nevertheless, these authors have awakened many to the need for more 
adequately addressing research to issues in education. 


Learning Theory Research 


What is here being called the learning theory approach to educational research 
includes attention to both operant (“Skinnerian”) as well as respondent (“Рау- 
lovian") conditioning, along with more humanistic approaches, each of which 
attempt to explain the process or processes through which learning is hypothe- 
sized to occur. To the extent that the amount of individual learning is measured, 
it is measured inferentially from an observed change in knowledge, attitude, or 
skill over some specified time segment. By controlling for exogenous factors 
(such as differences in “innate abilities”) we can attribute with relative safety 
that the residue is a function of some planned series of active interventions 
and exposure to resources that we collectively call the formal educational proc- 
ess. 

Learning most assuredly also occurs through the everyday maze of random or 
vicarious stimulation. Some would even suggest that the larger part of significant 
learning activities occurs in such situations. Such learning is excluded from anal- 
ysis here because it is substantially unplanned, idiosyncratic, and not directly 
amenable to accurate observation and analysis. While education, wherever and 
however gained, would be expected to affect individual outcomes, this analysis 
is restricted to education as a function of intentional school activities. 

Psychologists of all different professional stripes have attempted to come 
to grips with aspects of the educational process. Much recent attention has been 
focused on "behavior modification” derived out of the behaviorist (stimulus- 


response) orientation to psychology. Other approaches stressing empathic 


understanding, facilitative genuineness, sensory awareness, and other affective 


components have resulted in what are variously called human potential educa- 
tion, sensitivity training, or encounter group activities. 


Between these visible extremes lies a large middle ground. Almost universally, 


however, attention is directed to personal and environmental conditions as they 
influence change in individual behavior. Such a focus is no doubt long overdue. 


However, research on learning theory tends to be more morphogenic (idio- 
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graphic) than nomothetic. That is to say, research is focused on small scale indi- 
vidual experiments rather than comprehensive studies of multiple influences. 
While there is nothing wrong with this perspective (no other approach would 
uncover the variables discerned) results of such research do not present educa- 
tional policy makers with the type and quantity of information with which 
readily to make decisions concerning the deployment of human and fiscal re- 
sources. Results of learning theory research could and do specify the need for 
special developmental (i.e., *compensatory") programs or other special services. 
They would be of relatively less value in structuring the nature of general pro- 


grams and services for the vast body of students. 


Social-Cultural Gestalt 
Those identified with this approach would study a school—or more likely a 


School system—by observing the interrelations among teachers, staff, students, 
uch features as span of control, unity of command, 


and the larger community. S 
" management science would be 


and other characteristics of "closed system 


Stressed in terms of internal relations. 
While sociologists of this orientation would likely look at interpersonal 


relations and social structures inside and outside the system, political scientists 
would stress the relationship of outside events to internal dynamics. The most 
common mode of analysis for all of this research would be the case study. As 
with the literature of school reform, there is typically with this approach no 
manipulation of variables either statistically or experimentally. It is, therefore, 
difficult to posit causality or even correlation. While policy implications may 
emerge, it becomes difficult to test validity or reliability of results through 


replication. 


Analyses of Major Educational Interventions | | 
А productive line of inquiry, which has seen much recent use, is the analysis 


Of changes in student performance following massive interventions through the 
device of new programs commonly funded by an infusion of federal dollars. The 
attempt would not generally be to change a single educational resource, but 
rather to alter the total milieu of the school. Title I of the Elementary and Sec- 
Ondary Education Act of 1965 and the Head Start Program are ше most nated 
examples of such large scale intervention. Individual school districts and various 
State systems have conducted similar programs, although, naturally, of smaller 


Magnitude. 


bthis is contrasted with “open system" management often associated with input-output 


Studies; see Chapter Two. 
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One would expect, merely from a knowledge of the “Hawthorne effect” and 
from the spillovers and spinoffs of increased operating and equipment funds, 
that improvements of some magnitude would be clearly apparent. The results 
have not been so nearly unequivocal. 

It should be pointed out that, in contrast to the other approaches discussed 
here, this methodology is both a treatment and an analysis. Since the majority 
of intervention projects have aimed at amelioration of the learning difficulties 
and disabilities of low income (commonly minority) students, we can be less 
than certain about the effective impact of the educational innovations as well as 
the appropriateness of the measurements made of impact. We have learned that 
culturally different students not only may need different instructional ap- 
proaches, but also that standardized measures of cognitive achievement are 
likely to be sensitive to a pupil’s cultural background. (Conceptual and opera- 
tional difficulties of measurement are discussed elsewhere in this book.) 

Comparisons of the intervention strategy with other lines of research are 
tenuous at best, because of the active role of sizeable differences in funds in- 
volved. Since the main aim is large scale change directly, rather than research 
Suggesting possible large scale change at a later date, and since such significant 
quantities of “outside resources" may never again be available for use by the 
Schools, intervention studies must necessarily be relegated to a special category. 


In any case, this avenue of research is not available to the individual scholar 
seeking to replicate the process. 


INPUT-OUTPUT STUDIES 


Having briefly discussed other approaches to the measurement of educational 
effectiveness, the remainder of this chapter is devoted to a general discussion 
of the origins of and rationale for input-output studies in education. 

The input-output mode of analysis in education is of recent vintage, and in 
part reflects a general need to come to grips with the concept of “value added." 
This quest for a determination of the process effects of “ 
to input and output is not restricted to the educational 


part of the type of inquiry being undertaken in many seci 
Society. 


production" relative 
arena, but is rather a 
tors of contemporary 


The effort being made to fit an educational production function to activities 
of the schools follows that which was accomplished some years ago in the for- 


СА theoretical discussion relating input-output studies to general systems theory is con- 
tained in Chapter Two. 


See, for example, Hodgkinson (1972). 
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profit enterprises in the economy. While the specific methodology employed in 
analysis of industry needed to be modified somewhat, relevancy of the concept 
to education was demonstrated through an effort to apply characteristics applic- 
able to other “complex organizations" to the educational process. Education 
could no longer purport to be an organism unlike any other during a period in 
which systems analysts were showing commonalities among all types of sys- 
tems—social, industrial, and biological. 

In its most basic form, the process of input-output analysis is a research 
strategy through which one attempts to measure changes in system output(s) 
brought about by changes in the quantity and quality of system inputs. Through 
manipulation and analysis of system costs (financial, human, and informational) 
and of system benefits (explicit and implicit), one is able to better understand 
the nature of the transformation process taking place. 

Theoretically, one could accomplish such a procedure through actual experi- 
mental manipulation of inputs. As a practical matter, however, since some 
human inputs are not susceptible to experimental change, and since others could 
not ethically be changed to the detriment of living human beings, input-output 
studies most typically rely on statistical manipulation. 

Blalock (1960) indicates, and other statistics texts confirm, that statistical 
manipulation and control are directly analagous and comparable to actual 
manipulation and control of subjects (or resources) through experimental tech- 
niques—the approach most commonly used by social scientists. However, by 
statistically controlling for the influence of selected variables (and possibly 
extracting totally the effect of others), we are able to simulate changes that 
might not otherwise be possible without irreversible damage or serious prema- 
ture fixation of individual subjects. Additionally, statistical manipulation can be 
accomplished after the fact (sample characteristics permitting), thus providing a 
fruitful area for later research. 

Input-output studies appeared early in manufacturing industries. Heim (1972) 
points out the reasons why the methodology was not readily adapted to service 
industries generally, and to education in particular. First, the approach is most 
easily conceptualized when a specific, agreed-upon output can be measured 
directly rather than inferentially. Second, in regard to education, there is the 
difficulty of clearly separating school and nonschool variables that interact to 
create the system output. Third, such analyses are extremely difficult where 
there is a substantial lack of agreement about what the system outputs are or 
Should be. It might be added parenthetically that lack of consensus about the 
Outputs makes discussion of the process by which to elicit the outputs proble- 


matic at best. 
Heim (1972) concludes: 
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As a result of these and other forces, proportionately less effort has been 
extended to the question of input-output relationships in the education 
industry than is typical of industries producing more tangible products. 
Considering the size and importance of the education industry, the lack is 
especially striking (p. 10). 


As more educational resources are scrutinized within the input-output frame- 
work, more uses are being found for input-output techniques. The next chapter 
traces the relation of input-output studies to open systems theory and provides 
some uses of the technique as а management tool, particularly at the school 
district and postsecondary education level. 


Chapter Two 


Input-Output Analysis: A New 
Perspective for Education 


Having just passed through a period of great growth at all levels, American edu- 
Cation has most recently shifted its focus from issues of quantity to those of 
quality. A decline in the school age population, combined with the emergence of 


other competing societal priorities, have made educators aware that they will be 


increasingly called upon to demonstrate that the output of formal education is 


Commensurate with the magnitude of inputs being commit 
Processes, 

Educational inputs and outputs have been no 
{0 mention the problems of quantifying them or 


has been reached about their mere identification. A 
the determination of whether particular schools have performed satisfactorily 


in the past has been made in two basic ways: one could either look subjectively 
at the school setting and try to “feel” whether it appears to be working well, or 
one could attempt to make objective judgments about the resources being con- 
Sumed and the product being put out. The former is clearly the most commonly 
"Sed approach and has a long history of evolution; however, the latter method is 
the emerging approach and the one with which educators will need to deal if 
they are to justify enrichment of educational programs in the years ahead. 

It must be understood that problems remain in making educational inputs 
and Outputs operational and in developing a true educational production func- 
tion. For example, in studying the effects of schooling on equality of oppor- 


tunj м 
: nity, Jencks and his associates (1972) ехр | 
à ?ndardized test scores as a measure of educational attain 


In part: 


ted to educational 
tably difficult to specify—not 


nce some degree of consensus 
s Katzman (1971) points out, 


ment. They wrote, 


d on standardized tests. ... 


9 


We һауе looked at cognitive skills, as measure 
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We have not looked in any detail at habits, values, or attitudes. The reader 
should not infer that we think test scores more important than values or 
character. We take a dim view of test scores, both as measures of schools' 
effectiveness and as measures of individual talent. But while cognitive tests 
have many obvious defects, most measures of attitudes, values, and charac- 
ter structure are even worse. In the absence of evidence, theorists must 
rely on intuition and personal experience. These have proven a poor guide 
to the one thing we can measure, namely, cognitive skills (p. 12). 


Jencks's example is important to the comprehension of what follows because 
it argues that we must use indices, even though they are less than perfect, on the 
assumption that what information they do provide is better than having no 
objective information upon which to base important decisions. While we may 


still be far from the ultimate goal, each tentative step brings us closer to our 
objective. 


THE EMERGENCE OF INPUT-OUTPUT STUDIES: 
A SYSTEMS PERSPECTIVE 


Until the very recent past, educational institutions had not regularly undergone 
the type of critical scrutiny familiar to other “complex organizations"—notably 
the for-profit corporate structure. Education, it was said, was so different from 
the production processes in other segments of the economy that principles of a 
general nature about the structure, functions, and operations of other organiza- 
tions would not apply to educational institutions. In reviewing the available 


research on the organizational characteristics of American education, Anderson 
(1963) concluded that: 


22. the literature in this field was largely reminiscent, anecdotal, or horta- 
tory, and what passed for research was largely of the normative survey 
variety. . . . The procedures of the research or its findings did not tie in, in 


any systematic way, with what is being called a theory of organization or a 
science of management (p. 1). 


Ikenberry (1972) points out that the traditional inability to consider educa- 
tion, particularly higher education, within the context of general organizational 
theory has been due purportedly to the following factors: (1) lack of clarity іп 
the specification of specific, stable missions, goals, or objectives; (2) extreme 
decentralization of academic authority within institutions; and (3) the dispro- 


portionately high number of professional employees—that is, faculty and other 
professional staff. 


However, as the number of other service industries in our Society has in- 
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creased, it has become apparent that institutions other than schools share many 
of these characteristics and are still amenable to objective analysis. Some changes 
in terminology are needed to conform to different purposes and rationale, but 
much can be gained from application of the methodology developed for judging 
the effectiveness of functioning organizations in general. 

Willingness to examine the effectiveness of educational institutions in terms 
of use of resources vis-à-vis outcomes has come about, in large part, due to ac- 
ceptance of a systems perspective of education in line with general systems 
theory. A brief discussion of the development of systems theory would therefore 
be useful. 


SYSTEMS THEORY 


Churchman (1968) defines a system as “а set of parts coordinated to accomplish 
a set of goals" (p. 29). In a more detailed fashion, Hall and Fagen (1968) de- 
scribe a system as “а set of objects together with relationships between the 
objects and their attributes" (p. 81). They further define objects as the com- 
ponents of the system, attributes as the properties of the objects, and relation- 
ships as those things that “Не the system together" (p. 82). 

The value of a systems orientation is that it allows and encourages one to see 
the dynamic relationships that exist between the components and the environ- 
ment outside the system. In analogue, one could allude to the difference be- 
tween a movie and a snapshot: in the motion picture one can see not only the 
components and their attributes but also their paths of movement from one 
state to another. Rather than a static picture, the systems approach attempts to 
show and account for “flow of energy.” 

Increasingly, the attempt is to view organizations as open systems—that is, 
systems that interact with their environments. While the concept of open sys- 


tems originated in the study of thermodynamics (Bertalanffy, 1950), it appears 


to promise wide acceptance in many areas, not the least of which is management 


science. 

Gouldner (1959) introduced the terms “rational” and “natural” systems into 
е to correspond roughly with the physical concepts of 
closed and open systems, respectively. More recent theorists refer to closed and 
open systems directly. The closed system sees the organization as an instrument 
which can organize itself internally more or less independently of the conditions 
outside the system. The open system, on the other hand, is viewed as an orga- 
nization which is in dynamic equilibrium, maintaining itself “іп exchange of 
materials with the environment and in continuous building up and breaking 
down of components” (Bertalanffy, 1950, p. 23). 


the management literatur! 
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Authors generally associated with the closed system approach include Henri 


Fayol, Frederick Taylor, Max Weber, and Elton Mayo (Hall, 1972). Irrespective 
of their substantive differences, each of these writers strove to find the “опе best 
way" of organizing internal structures and conditions. Two of the most well 
known dicta deriving from this perspective are those dealing with span of control 
and unity of command. The approaches identified by the terms "scientific man- 
agement," "human relations management," and "the study of bureaucracy” 
have wide currency outside the field of management. 


Relatively fewer people are familiar with the newer -open systems model, 


however. Lawrence and Lorsch (1967) put the matter this way: 


Until very recently, organization researchers and theorists have tended to 
view the internal functioning of effective organizations as if there was one 
best way to organize. No attention was devoted to the problem in which 
we are interested —that different external conditions might require differ- 


ent organizational characteristics and behavior patterns within the effec- 
tive organization (p. 14). 


Katz and Kahn (1966) have written what many consider the definitive work 


оп open systems. They state: 


The theoretical concepts should begin with the input, output, and func- 
tioning of the organization as a System and not with the rational purposes 
of its leaders. . . . Our theoretical model for the understanding of organiza- 
tions is that of an energic input-output system. .. . Living systems, wheth- 
er biological organisms or social organizations, are acutely dependent upon 


their external environment and so must be conceived of as open systems 
(pp. 16, 18). 


Katz and Kahn go on to discuss the key elements of all open systems, wheth- 


er biological or social. They detail the following nine separate characteristics, 
the headings of which are repeated in their terminology. 


1. 


. The throughput. Some transformation of the 
. The output. Some product of the transfo 


- Systems as cycles of events. 


Importation of energy. Some form of energy is put into all living systems in 
terms of money, people, material, and/or information from the environment. 


inputs takes place within the 
system. 


rmation process is exported back 
to the environment. 


There is a pattern within systems that is rein- 
forced by the export of outputs to the environment. Internally, there are also 
patterns that recur as new elements are put in. 


Input-Output Analysis: A New Perspective for Education 13 


5. Negative entropy. Entropy is the process whereby systems tend to run 
down, decompose, etc. over time. Building negative entropy entails the de- 
velopment of means through which the system is replenished. 

6. Information inputs, negative feedback, and the coding process. Informa- 
tion can be as much of an input as are physical commodities. Negative feed- 
back is information that deflects the organization back to a planned course. 
Positive feedback merely maintains present course. A thermostat is an ideal 
analogue: temperature change is information to the thermostat to bring 
temperature back to its preset level (negative feedback); positive feedback to 
thermostat merely "says" that the temperature setting on thermostat needs 
to be changed. Coding determines what information inputs will be monitored. 

7. The steady state and dynamic homeostasis. Though elements are constantly 
being imported and exported, open systems characteristically maintain a 
steady state. This is homeostasis rather than true equilibrium, since there is 
movement, but the relation of energy in and out is constant. A safety margin 
of energy is put in and stored to arrest entropic process. 

8. Differentiation. Open systems tend to move toward a more complex form 
and a more specialized division of activities. 

9. Equafinality. In open systems there are multiple paths to the same goal. 


There is no “опе best way." 


Principles such as these quite obviously give us a new set of parameters within 
which to evaluate the functioning of organizations. Since they were conceived 
to be of universal applicability, they do not have the closed system disadvantage 
of being ideosyncratic to particular settings (such as the profit sector of the 


economy). 


INPUT-OUTPUT TECHNIQUES AS A 
MANAGEMENT TOOL 
IN EDUCATION 


The basic concepts of input-output analysis have been used in different ways 
in the various levels and settings of our educational system. In higher education 
the unit of analysis has been the academic department (and other cost centers), 
and stress has been on dollar inputs. In contrast, input-output studies of ele- 
mentary and secondary education are concerned with the individual student as a 
unit of analysis, with individual characteristics and sociocultural factors as inputs 
into the process through which competencies (the output of the system) are 
developed. Use of the flexible input-output approach in such diverse ways lends 
to the overall heuristic value of the concepts. 
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Since the emphasis of the present study is on the explanation of student per- 
formance in the elementary and secondary school setting, use of input-output 
techniques as a financial management strategy in higher education will be dis- 
cussed here only briefly before delving directly into the topic at hand. While 
input-output studies of higher education conceived of as management 
tools are a more limited view of the total utility of the approach, they do dem- 
onstrate the variations of the theme in education as a whole. 

Rourke and Brooks (1966) believe that there has been a “managerial revolu- 
tion in higher education” under way since the early 1960s. In their view, the 
new approach to higher education administration has come about due to: (1) ex- 
panded use of computer assisted records systems; (2) extensions of institutional 
research capabilities; and (3) the adoption of new management tools originally 
used in other “complex organizations.” 

Most characteristic of the new management tools applied to higher education 
is the Planning, Programming, Budgeting System (PPBS). First implemented 
in the Department of Defense (Hitch, 1971), the system was being used in all 
federal agencies by 1965. PPBS can be considered one specific technique of the 
general approach known as cost-benefit analysis. Hu, Lee, Stromsdorfer, and 
Kaufman (1969) define cost-benefit analysis as “a procedure by which relevant 
economic and noneconomic criteria are applied to cost and benefit data to com- 
pare the relative merits of alternatives” (p. 20). Succinctly stated, the intent is 
to compare not only the costs of different alternative courses of action but also 
the benefits that each would produce. 

This approach differs markedly from what institutions of higher education 


attempted to do in the past through budgetary and planning functions. As Clark 
and Huff (1972) point out: 


Traditionally, institutions have planned and budgeted on the basis of 
inputs to departments in the form of dollars, faculty, staff, physical facil- 
ities, etc. Relatively little reference was made to the outcomes of the pro- 


grams those departments support. Thus, resource requests in traditional 
budgets have failed to link costs to program outcomes (p.5). 


Since program budgeting is the most frequently adopted vehicle of cost- 
benefit analysis, the present description will focus 


nique. Parden (1971) notes that a planning, 
be conceptualized in terms of the following te: 


primarily on this specific tech- 
programming, budgeting cycle can 
n sequential steps: 

1. Establish objectives and goals. 


2. Develop alternative programs that will accomplish the same goal. 
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Estimate resource requirements for each alternative. 

Estimate benefits to be gained from each program alternative. 

Develop an operating plan by selecting from among alternatives. 

Test the long range fiscal implication of the plan. 

Compile the annual budget. 

Evaluate the success with which program benefits are achieved. 

Revise planning standards. 

Repeat the cycle to accommodate changes in objectives, goals, available re- 
sources, and the institution's environment (from pp. 203-208). 


O 9L NMS w 


The way in which these ten steps are put into the planning, programming, 
and budgeting process is described by Farmer (1970) thus: 


Planning—the selection or identification of overall, long range objectives of 
the organization and the systematic analysis of various courses of action in 


terms of relative costs and benefits. 


Programming—deciding on the specific course of action to be followed in 


carrying out planning decisions. 


Budgeting—translating planning and programming decisions into specific 


financial plans (p. 7). 


Weathersby and Balderston (1971) view the matter similarly and add a time 
frame for the entire process. Their schema is presented in Table 2-1. According 
to Dilley (1968) the implementation of such a programmed budget format 
ameliorates many of the problems of traditional “line item" budgets by pro- 
viding: (1) a record of accomplishments as a function of costs, (2) detailed 
planning for the whole institution as well as its parts, (3) planning in specific 


Table 2-1. A Planning -Programming-Budgeting Schema? 


Function Lead Time Activity 
Planning 5 to 15 years Articulate global objectives, costs, 
and benefits. 


Translate global objectives into a 


Programming ] to 5 years 4 
specific short range course of action. 
Budgeting 0 to 1 year Determine specific financial, man- 
power, and policy plans toward 


goals. 


^ Adapted from Weathersby and Balderston (1971), p. 4. 
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written form so that it can be discussed and reviewed by all involved, and (4) 
planning in time perspective so that alternative courses of action can be evalu- 
ated in terms of long term capabilities.? 

Before delving directly into a description of the types of input-output analy- 
ses that have been performed with regard to individual performance in the ele- 
mentary and secondary schools, it is appropriate to mention briefly another 
spinoff of the basic approach that is generating much interest in educational 
circles. 

Increasingly, attention is being centered on the development of criterion 
based school curricula. Also known as competency or performance based educa- 
tion, the new emphasis is placed on determining what specific skills are requisite 
to particular educational attainments (as a measure of school output), in con- 
junction with a specification of the inputs necessary to reach these attainmen ts. P 
With regard to teacher education, the requirements for certification in many 
states have been radically altered to provide for competency based programs as a 
substitute for presentation of selected course work. In New York and Texas, 
ability to demonstrate specific competencies has now been mandated as the 
sole route to teacher certification (Rosner and Kay, 1973). Clearly, the attention 
of many has now been directed toward the actual cognitive and noncognitive 
abilities of students leaving educational institutions. This approach is in stark 
contrast to traditional reliance on the degree or diploma as a credential in itself. 

While the approaches discussed in this section indicate the diversity of present 
and potential uses of input-output methodology, the most common use of input- 
output analyses (and the one pioneered by economists) has concerned the de- 
velopment of a tentative production function for elementary and secondary 
education. It is this topic that forms the basis for the next chapter. 


@ Additional information on PPBS implementation and implications can be found in 
Newton (1972), and Huff and Manning (1972). 

Much of the work on criterion based education has taken place in the context of 

teacher preparation programs. While a discussion of these efforts is not within the scope of 


this volume, additional information can be found in Schmieder (1973), Elam (1972), and 
Broudy (1972). 


Chapter Three 


Production Functions in 
Secondary Schools 


It has been stated earlier that the educational production function relates educa- 
tional inputs to educational outputs. To describe a production function there- 
s, outputs, and the process by which 
briefly on the under- 
cess in reference 


fore we need information about input 
inputs are transformed into outputs. This chapter focuses 
lying characteristics of outputs, inputs, and the input-output pro 
to the secondary school system. 

In very general terms, it is commonly recognized that educational outputs 
are functions of a number of types of input. They include student characteris- 
tics, school related factors, and other community influences. The school related 
factors are of particular interest to economists because these are the inputs 
that typically can be manipulated by school administrators and hence influence 
resource allocation in education. The remaining inputs are also of concern and 
interest, and public policy can surely influence many such factors, especially 
Over the long run. 

Moreover, it has become apparent that an educational system cannot be as- 
Sumed to produce a single output, such as basic skills in reading and mathe- 
matics, either to the exclusion of or entirely independently of other outputs. 
Even if one is not interested in other outputs, the interdependence among the 
Outputs requires an analysis involving other outputs as well. Finally, even if one 
is able to identify and measure all the relevant inputs and outputs, there remains 
the task of describing the process by which inputs are transformed into outputs. 
This latter task is formidable, and very little progress has been made on this 
Score despite the recent surge of studies on educational production. 
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INPUTS 


Much progress has been made both in identifying and measuring educational 
inputs. At the secondary school level, we must distinguish between inputs pro- 
vided by the schools and those externally determined. Among the school factors 
we may wish to further distinguish between easily manipulable factors and those 
not easily manipulated by the administrators. Among the nonschool factors we 
may wish to distinguish between those factors that affect a student directly and 
those affecting the student indirectly through a community's environment. 


School Inputs 

The identification and quantification of school related inputs is not an easy 
task. The school's environment includes both human and physical resources, and 
each of these categories is highly complex. Moreover, in attempting to evaluate 
the contribution of a given input to the output of a given student or class of 
students, it is often difficult to ascertain which portion of the input under dis- 
cussion is relevant to the current investigation. 

For example, if the present analysis is concerned with the educational output 
of students completing eleventh grade, should we evaluate teacher characteristics 
of those teaching eleventh grade only or should we also include other teachers in 
the measurement? Further, should we attach weights to the characteristics of 
the various teachers based upon the time they contribute to the eleventh graders 
(recognizing that many, if not most, are likely to teach in other grades as well)? 
Moreover, would average teacher characteristics be sufficient, or should one 
attempt to disaggregate the teaching staff into a number of components (е.в. 
vocational, science, language arts, etc.)? 

To make things even more complicated, it has been argued that even success- 
ful measurements of such variables as teacher characteristics provide only 
proxies for the real inputs (Mood, 1970). For example, a variable measuring the 
educational preparation of teachers only indicates an average teacher attribute, 
not a teacher input. Its use in the production function is based on the assump- 
tion that once having such an attribute, an input into the production process is 
also likely to result. Thus average educational preparation is used as a proXy 
for the organization and quantity of knowledge that teachers attempt to trans- 
mit to students. 

This, of course, is far different from the definition of inputs in ordinary pro- 
duction analysis, where an input is measured in real terms (such as tons of steel) 
and not through a proxy. One should not therefore be surprised if some of the 
input proxies do not appear to exert any statistical influence on the outputs. 
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The conclusion is not necessarily that the input is ineffective, but perhaps that 
the evidence does not support the contention that the proxy used is indeed a 
good index of the real input. 

School inputs include both human and physical inputs. A comprehensive 
study would require an investigation of both. Among the physical inputs one 
could distinguish building characteristics (the technological design with respect 
to both instruction and ease of communication among related groups of faculty 
members, general condition of facilities, etc.), quantity and quality of equip- 
ment, both for vocational instruction and teaching aids (audiovisual, etc.), and 
supply room and other supporting physical facilities. The human inputs typically 
emphasized in studies of this nature include teachers, administrators, secretarial, 
clerical, and other auxiliary staff, counselors, and paraprofessional teaching 
aides. Since a large fraction of schools’ budgets is spent on the teaching staff, 
much attention has been directed to the efficacy of teachers, and various meas- 
ures reflecting their attributes have been proposed and employed. 

A popular variable measuring teacher input is average teacher salaries. Al- 
though it has considerable appeal, it is lacking in many respects. An average 
teacher’s salary is typically based on a teacher’s experience and educational 
Preparation; thus the assumption that teacher salaries are a good proxy for 
teacher input implies that salaries alone are a good measure of teacher produc- 
tivity. It would be surprising if such an implication can be shown to be true, in 
light of the fact that salaries take no account of teachers’ talents, enthusiasm, 
resourcefulness, and dedication to the profession (Cohn, 1970 and 1973). 

Moreover, teaching experience could serve as both a positive and a negative 
input proxy; on the one hand, experience is a proxy for “on-the-job training" 
and “learning by doing.” An experienced teacher knows the ropes, as it were, 
and thus can save considerable time and energy with regard to lesson preparation 
and discipline problems. At the same time, experience may also be a proxy for 
professional obsolescence and depreciation of human capital (when other vari- 
ables are held constant). The effect of experience on educational production 
will therefore depend on the extent to which one input represented by experi- 
ence is offset by the other. 

What the foregoing discussion implies 
tially productive attributes of teachers, including educational preparation, ex- 
perience, resourcefulness, talents, attitudes, and classroom practices. Even if a 
school is successful in recruiting a staff with excellent productive attributes, 
teacher productivity would be reduced to the extent that teachers are overbur- 
dened in terms of excessive teaching load and the number of subject matter 
assignments they are required to handle each year. In consequence, input 


is the need to examine various poten- 
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proxies measuring the extent of teaching load and subject matter preparation 
should be included in the system. These variables are all the more interesting as 
they may be manipulated relatively easily by the school principal (Cohn, 1971). 

In addition, one should not lose sight of the possibility that different class 
sizes might also influence teacher productivity. Other school related variables 
include the breadth and depth of the curriculum, the sheer size of the school, 
the type and extent of extracurricular activities, and the nature of and acces- 
sibility of students to the school library. 


Nonschool Inputs 


It is by now common knowledge that factors outside the school itself are 
likely to contribute substantially to a student's educational output.” Peer in- 
fluence is one such general factor. Interest may then be focused on the general 
characteristics of the student body—among them parental socioeconomic levels 
(measured by family income, educational level of mother and father, number 
of books at home, etc. Race, sex, family size, and other attributes have all fre- 
quently been mentioned. In addition, general characteristics of the student 
environment (community indices) are alleged to affect educational outcomes. 
They may be measured by degree of urbanization, extent of poverty and exis- 
tence of substandard housing, racial composition, average educational attain- 
ment of adults, and average personal income and wealth. The attitude of the 
local community toward education may be captured by such variables as the vot- 
ing record on school bond issues, or tax effort, as measured by the ratio of 
school tax receipts to total taxable property value. 

Another input that conceptually should be included in the model is the initial 
educational endowment of the students. Inclusion of such a variable would per- 
mit analysis of the gain in output over a given time period. Although some of 
the variables discussed above regarding student socioeconomic characteristics 
are typically correlated with initial educational endowment, they are clearly 
a less than ideal alternative. As Levin points out, however, the innate endow- 


ment variable "is usually omitted for lack of a reliable measure" (Levin, 1974, 
р. 5). 


Manipulable vs. Nonmanipulable Inputs 


Quite obviously, some of the aforementioned inputs are not manipulable by 
school or any other government officials. A good example is sex, race, and age of 
students. In addition, some inputs are more easily manipulable than others. For 
example, parental education and socioeconomic status could, in principle, be 


For a detailed survey consult Averch et al. (1972). 


5с 
Dat 


Production Functions in Secondary Schools 27 


manipulated, but this cannot be accomplished by school officials, nor can it be 
accomplished quickly and easily by other government bodies. The conclusion 
of the Coleman Report and various other studies regarding the strong effect of 
nonschool variables on educational output has ramifications for long run social 
policy, but it provides little comfort to school officials who strive to increase 
educational output with shrinking budgets (measured in real terms). It is for 
this reason that this study emphasizes manipulable inputs. 

Among manipulable inputs subject to control by various hierarchies in the 
school system, mention may be made of the following: (1) teaching load, (2) 
average number of subject matter assignments per teacher, (3) class size, and 
(4) number of curriculum units. These inputs may be manipulated to some 
extent by the school principal (and, of course, also by the superintendent). 
Given a fixed number of teaching positions, the principal can choose between a 
smaller class size and heavier teaching load, and also between a smaller number 
of curriculum units per semester and a smaller number of subject matter assign- 
ments per teacher. 


Although the principal is typically constrained in his decision making process 
by rules requiring a ceiling on class size and/or a floor on curriculum units—as 
well as by collective bargaining agreements pertaining to such matters as teaching 
loads and assignments—there is likely to be a good deal of room remaining for 
maneuvering the four variables so that significant improvement in educational 
output may result. What we wish to emphasize here is that although some inputs 
could be manipulated at the school level, in the absence of information relating 
inputs and outputs, gains from such manipulations are not likely to be reaped 
(see Cohn, 1971 and 1974b). A number of other inputs may be manipulated 
also, especially at the district level. These include teacher experience and train- 
ing (through changes in hiring policies), teacher salaries, availability of equip- 


ment, supplies, library facilities, and so forth. 


OUTPUTS 


The outcomes of education from the standpoint of economic analysis may be 
Classified into two categories: consumption and investment (Schultz, 1963). The 
Consumption aspect is related to the joy, pleasure, and similar benefits derived 
by students, their families, and society as a whole. The student might sometimes 
experience negative consumption (he or she would rather do something else), 
but activities such as music, sports, arts and crafts, and the like appear to con- 
tribute to a student's enjoyment of school and hence to consumption benefits. 


In addition, the family is relieved of responsibility toward the youngster during 


the school hours—a highly important consumption benefit often overlooked by 


ERT., West Bengal 
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teachers and parents alike (Weisbrod, 1962, especially pp. 116-118). Society, 
too, gets consumption benefits in the form of reduced crime, the enjoyment 
people get from observing youngsters learn, play, and behave in an orderly 
fashion, and perhaps even the lessened competition for jobs created by keeping 
job-ready youth in school for additional three to four years. 

The investment component includes a variety of outputs related to the en- 
hancement of an individual's or society's productive skills and future well being. 
The distinguishing characteristic here is that some of the educational outputs 
will not provide benefits to society until some time in the future (some will 
come sooner, some later). Obvious examples are the acquisition of basic mathe- 
matical and verbal skills, vocational preparation, improved health habits, incul- 
cation of social and moral values leading to improved citizenship, or improving 
one's attitudes toward self, family, peers, and society. 

It is much easier to specify the kinds of educational outputs than to define 
them in precise terms. Not only is it not unanimously agreed what attitudes 
toward, let us say, sex should be, but even for such outputs as increased knowl- 
edge in basic skills it is not quite clear how a student's or a school's performance 
can be measured. Thus we find a number of different basic skills test batteries, 
all purporting to measure the same output. 

The question posed most frequently is not merely what the present level of 
Skill is, but rather what improvements in basic skills have taken place over à 
certain time period. Furthermore, even if only the present skill level is adequate, 
we must contend with the “ceiling” problem. That is, it becomes successively 
more difficult to increase a student's score as one approaches the maximum 
Score, so that statistical comparisons of the type described herein are likely to 
underestimate the ability of some schools to manipulate inputs to achieve higher 
skill levels (and, conversely, overestimate it for other schools). 

Educational outcomes are often referred to in the educational literature as 
cognitive or noncognitive. This classification is especially important since few 
noncognitive outputs have been incorporated into educational input-output anal- 
ysis to date. From an economic viewpoint, however, the distinction is of little 
value, as both cognitive and noncognitive aspects of the educational process 
provide consumption and/or investment benefits. Our attempt here is, therefore, 


to list as many of the relevant outputs as possible, and obtain reliable means by 
which such outputs may be measured. 


Relevant Outputs 


Basic Skills. A student's success in acquiring new mathematical or verbal 
skills has for long been the cornerstone of the analysis of educational perform- 
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ance. Many test batteries are available: the Iowa Tests of Basic Skills, the Iowa 
Tests of Educational Development, the Stanford Achievement Test, or the well 
known college entrance tests, such as the ACT and SAT. АП these tests have 
been utilized in one or more input-output studies of education, as will be shown 
later. 


Vocational Skills. Despite the fact that huge sums have been invested in 
vocational education, no systematic vocational tests of the type developed for 
basic skills have been used to assess the performance of vocational education. 
Instead, market oriented studies have been undertaken to assess the contribu- 
tion of vocational education to one's employment opportunities and/or earnings 
(Hu, Stromsdorfer, and Lee, 1971, Corazzini, 1968, and Taussig, 1968). Since 
vocational development is clearly an identifiable educational goal, its exclusion 
from a formal model of the educational process cannot be tolerated. 


Creativity. This is another dimension of school output long ignored in input- 
output studies. Yet some schools do attempt to foster creativity. Measures to 
assess the success of schools in that area should include both creative output (a 


measure of consumption benefits) and increasing creative potential (investment 


benefits). 


Attitudes. Because attitudes are difficult to quantify, and because, as noted 
earlier, society is not unanimous about the "proper" mix of individual attitudes, 
it is not surprising that student attitudes have rarely entered a formalized educa- 
tional input-output model? Yet one of the main functions of schools (fre- 
quently cited in state constitutions) is the inculcation of “proper” attitudes. 


These include attitudes toward oneself, toward one's peers, family, the commun- 
ool, and the world in which we live. One might 


pt to influence a student's life style, 
and sex and family education. 
ly difficult. It is not impossi- 


ity, society at large, the sch 
include in this category a school's ает 
including career aspirations, health habits, 


Measurement of such outputs is clearly extreme 
ble, however. Just as tests of cognitive skills have been developed and utilized 


Over a span of more than half a century, 50 too instruments can (and some have 
been) developed to measure attitudes. Psychologists have by now amassed an 
incredible amount of experience in measuring motivation, job satisfaction, and 
Other types of attitudes, and similar effort can be directed to the measurement 
of attitudes that comprise educational outcomes. A later chapter provides data 
On a number of attitude outputs adopted in the Pennsylvania Plan. 


DA notable exception is a recent study by Mayeske and his associates (1973b). 
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Other Outputs 

A number of other outputs should be mentioned. For example, Burkhead 
et al. (1967) used the inverse of the dropout rate as an output of the secon- 
dary school system. This is perhaps mainly a consumption type of output, 
as some studies indicate that the investment value of dropout prevention 
programs is not likely to be positive (Weisbrod, 1965; Ribich, 1968, pp. 51-60). 
Also, the role of some schools as welfare stations should be studied, as students 


from poor homes receive hot meals, stay in a warm and a relatively sanitary 
place, receive counseling, and so forth. 


d sports have generally been 
onsumption benefits, and in 
ge scholarships in athletics or 
ists) also investment. 


THE INPUT-OUTPUT PROCESS 


The description and quantification of the inputs and outputs is necessary but 
not sufficient for input-output analysis. It is also 
ner by which inputs inf} 


Е ion, when all other inputs 
Although these subject i 
уеу, analyses of the survey data largely us, 
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are held constant, should result (at some point) in successively smaller incre- 


ments to output. 
Considerable work has been directed toward identification and estimation of 


the "best" production function, based on both theoretical developments and 
empirical investigation of various industries. One must remember, however, that 
the education “industry” is far different from most other industries in scope and 
character, and that furthermore we are faced with the difficult problem of multi- 
ple outputs in the production process. It is therefore not too surprising to dis- 
cover that few analyses of the educational sector have been patterned after the 
typical industry production model. 

It would be worthwhile to restate the problem with the aid of mathematical 
notation. Let the vector of educational outputs be denoted by 0:41,42...-4у» 
the vector of school related inputs by X: x4, X5. . .. „Хр, and the vector of non- 
School inputs by S: is EX eas ‚Зп: We thus have a total of п outputs and k +m 
inputs. The generalized educational production function is given by: 


f(Q,X/S) 0 (3-1) 


That is, once the levels of the nonschool inputs are given, the determination of 
the expected levels of the outputs will depend on both the levels of the school 
inputs and the functional operator, f (which specifies the shape of the produc- 
tion function). If diminishing marginal returns for each productive factor are to 
hold, then 924,/2х2 < 0, for all i This condition does not hold for a linear pro- 
duction function, yet the vast majority of studies in educational input-output 
analysis specify linear functions (as does this study).d 

A linear relationship between the X inputs and the Q outputs would be 
empirically valid to the extent that the curvature of the total output function 
is only mildly violated by employing a linear approximation. This is illustrated 
in Figure 3-1 , in which a total output curve is drawn for one input and one out- 
Put. To the extent that the range of the data is given by the arc segments AB or 
BC, a linear approximation would appear to provide reasonably good estimates 
of the true production coefficients. However, if the range of the data is given 
by the arc segment AC, the linear approximation will seriously distort the true 
relationship between the input and output. Moreover, conclusions derived from 
linear analysis should not be applied to input levels beyond the range of the 
Sample observations. For use of the production coefficients for the purpose of 
extrapolation might result in predictions that are far off the mark (compare, for 
example, point C with an extrapolation of the line segment AB to C, or point A 


“ма і d the technique of “сгИегіоп scaling" to account 
yeske and his colleagues have use т 
for nonlinear relationships. See Beaton (1969), and Mayeske et al. (1972), рр. 10-11. 
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TOTAL OUTPUT 
CURVE 


UNITS OF OUTPUT 


О UNITS OF INPUT 


Figure 3-1. Total Product Curve and Linear Approximations 


with an extrapolation of the line segment BC to А”). These conclusions about 
extrapolation are no less pertinent to models that employ curvilinear analysis. 
because the shape of the production function may be different from that as- 
sumed or inferred at unobserved input levels, and t 
errors remains. 

If a linear model is acce 
function is given by: 


he danger of extrapolation 


Pted, then the general form of the ith production 


yy 


n k m 
qj7aj* > 54, + Ў СХ + У d.s. (3-2) 
gel h=1 j=1 


where а; is the intercept (constant term), and the 5 


ig 5» Сиг, and а, are the 
(slope) coefficients we wish to estimate, with bj; = 0. This equation assumes 
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linearity in all variables, and that some of the outputs other than 4; might have 
coefficients different from zero (a good number of the bigs could, of course, be 
equal to zero). Of particular interest are the coefficients су, which represent the 
marginal productivities of the school inputs, about which most of our subse- 
quent discussion will concentrate. 

Since there are п outputs, n equations of the general form (3-2) will be spec- 
ified. As long as not all the big's are zero, it is apparent that the various equa- 
tions will not be independent of each other. Thus the determination of the true 
effect of a given school input (e.g., x) on any one output (e.g., 4 |) cannot be 
determined without finding out its effect on other outputs. For if that input 
(х1) affects other outputs, which in tum һауе an impact оп q}, then the total 
effect of the input on q, would differ from what an isolated examination of the 
production function of q} would reveal. The п equations of the type (3-2) 
should therefore be considered as an interdependent system, and the coefficients 
in each of the equations should be estimated on the basis of techniques available 
for simultaneous equations (Johnston, 1972, Chapters 12 and 13). 


CONCLUDING COMMENTS 


Despite the numerous difficulties involved in identifying and measuring the in- 
puts and outputs of education and in describing the input-output process, con- 


Siderable work has been done in recent years in this area. As Chapter Four 


demonstrates, research has focused on a number of input-output frameworks 


in the belief that eventually some consistent results will emerge as an ultimate 
Buideline for policy decisions. 

If the ultimate goal has not yet been achieved it is not to be construed as 
Prima facie evidence against the existence or the practical usefulness of the 
Production function technique. Rather, it is a testimony to the overwhelming 
problems associated with conducting a sound production function study of ele- 
mentary and secondary education. Progress is likely to be made only slowly, and 
then only provided that researchers do not abandon their search in the area. 
Chapter Four clearly shows that despite the lack of consistent results, the effort 
continues and has reached successively higher levels of sophistication. A review 
Of the recent literature is therefore clearly in order. 


Chapter Four 


Input-Output Analysis in the 
Development of an Educational 
Production Function for Elementary 
and Secondary Schools 


The preceding chapters have successively described the need for and state of 
research on educational effectiveness and presented various models of research 
used to assess the impact of school, nonschool, and interpersonal influences on 
educational outcomes. Through all of this, emphasis has been placed on the 
value and uses of an input-output approach to assessment in the educational 
arena. 

No model or models are without drawbacks, conceptual or operational. 
Certain designs systematically (if unavoidably) disregard or distort important 
influences related to the eventual outcome. Others provide a more adequate 
framework for including all necessary and sufficient inputs, assuming all needed 
information is available. Commonly all such information is not available, and in 
fact could not as a practical matter be made available. 

А compromise is thus in order. The education policy maker, and thus the 
educational researcher, must participate in an inherent trade-off. A decision 
must be made in terms of the most all-inclusive model that can be adopted in 
terms of the amount, type, and level of data that can reasonably be expected 
to be collected without in itself interfering with the ongoing instructional and 
Support processes, the improvement of which is the sole purpose of the research. 

In our view, the input-output model best accommodates itself to the situ- 
ational and theoretical constraints. We have previously pointed out the diffi- 
culties in using aggregated student data when individual data would be most 
appropriate. The level of aggregation used in existing studies is presented in 
Table 4-1. Most studies clearly fall into the middle columns of the figures. More 
important, by observing the temporal sequence, one notes that later studies are 
more likely to be toward the right, and some studies have already operated at 
the individual student level of analysis. Obviously, the state of the art is making 
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individual student analysis more possible, and the theoretical problems are be- 
coming less difficult. 

In terms of former operational difficulties, similar improvement is being made 
through use of more sophisticated statistical management. Method of statistical 
manipulation is shown in Table 4-2. That increasing numbers of studies are 
utilizing two stage least squares (TSLS) in simultaneous-equation production 
functions serves to lessen the bias associated with the ordinary least squares 
(OLS) method. 

There still must be some concern with the facts that (1) standardized test 
Scores are not satisfactory proxies for actual competencies, and (2) noncognitive 
(i.e., affective) inputs and outputs have for the most part been totally ignored. 
However, it must be made clear that these are not problems associated with the 
input-output model per se; rather, these are difficulties inherent in the types of 
data and institutional characteristics the educational researcher confronts, and 
progress to overcome these difficulties will perforce be very slow. 

With these caveats in mind and with an understanding of what the public is 
demanding under the general rubric of “accountability,” the input-output model 
holds out the best hope of making a positive contribution to assessment of edu- 
cational effectiveness. The remainder of this chapter thus proceeds to discuss 
existing studies of input-output in the public schools. Studies are discussed in 
chronological order, for the later studies are more sophisticated and build on past 
research successes and failures. A thread can thus be discerned through the 
progress which has been made. 


Such an arrangement of studies allows the interested reader to draw compari- 


sons with other similarly organized compendia of related studies available else- 


Where.* However, the stress in this synthesis is placed upon studies utilizing 
production functions based on simultaneous equation systems. It should be 


noted that no attempt is made here to provide an exhaustive review of all edu- 


cational input-output literature; yet we believe that the following survey encom- 


passes most of the major works in this area. 


THE INPUT-OUTPUT STUDIES: A SURVEY 


This section provides basic information about a number of input-output studies 
reported in the professional literature from 1956 to the present. In à sense, 
input-output analysis is not new; yet use of the term itself аай келен ш what 
it means have increased markedly in recent years. Studies discussed in this sec- 
tion are summarized in Table 4-3. | 

It is generally recognized that the first large scale input-out 


а See. for example, Heim (1972, 1973); Averch, et al. (1972); and Guthrie (1970). 
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Table 4-3. 
Components 
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Summary Chart of Effectiveness Studies on School Service 


PEN ы пса лана деци осын ee Sui tit 


Study 
Author(s) 


1. Mollenkopf 


Description of 
Sample 


U.S., 17,000 9th (in 


Performance 


Aptitude and 


Measure of Pupil Measure(s) of Effective 


School Service Component (s) 
(School Output) (School Input) 


1 


. Number of special staff 


and Melville 100 schools) and achievement 2. Class size 
(1956) 12th (in 106 schools) tests 3. Pupil-teacher ratio 
grade, male and 4. Instructional expenditures 
female 
2. Goodman New York, 70,000 Achievement 1. Number of special staff 
(1959) 7th and 11th grade, test 2. Instructional expenditures 
male and female in 3. Teachers' experience 
102 school districts 4. “Classroom atmosphere" 
3. Thomas Project TALENT Achievement 1. Teachers' salaries 
(1962) sample (national) test 2. Teachers' experience 
10th and 12th 3. Number of library books 
grade, male and 
female 
4. Green et al. Virginia (Primarily Stanford 1. Aggregate measure of 
(1964) Negro) Secondary Achievement entire instructional 
students test program 
5. Benson et al. California 5th Reading 1. Teachers’ salaries 
(1965) grade, 249 school achievement 2. Administrators’ salaries 
districts test 3. Instructional expenditures 
6. Kiesling (1969) New York, 70,000 Achievement 1. Expenditure per pupil 
7th and 11th grade test (negative) 


male and female in 
102 school districts 


Verbal ability 


tr 


— 


. Student/teacher ratio 


. Teachers’ verbal ability 


7. Coleman U.S. Sample Equality 


. Teacher turnover 


tests and school 
. Teachers' salary 


holding power 


Report (1966) of Education Oppor- test 
tunity Survey (EEOS) 
8. Burkhead et al. 90,000 Chicago high Aptitude and 1. Age of building 
(1967) school students. achievement 2. Teachers' experience 
3 
4 


19,000 Atlanta high 
school students in 
22 schools and 180 
small community 
high schools 
Iowa high school Gain in achieve- 1. Teachers' salary 
students in 377 ment test 2. Number of instructional 
school districts (ITED) assignments per teacher 

3. College hours per teaching 


assignment (negative) 


9. Cohn (1968) 


1. Teachers' salary 


10. Raymond W. Virginia, 5,000 Freshman year 
(1968) high school (college) GPA and 
students achievement test 


scores 


ши cad E 
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Table 4-3 continued 


Study 
Author(s) 


Description of 
Sample 


Measure of Pupil 
Performance 
(School Output) 


Measure(s) of Effective 
School Service Component(s) 
(School Input) 


11. Katzman 
(1968) 


12. Bowles (1969) 


13. Bowles (1970) 
14. Bowles and 

Levin (1968b) 
15. Hanushek 


(1968) 


16. Fox (1969) 


17. Levin (1970) 


18. Michelson 
(1970) 


19. Guthrie et al. 
(1971) 


Elementary school 
students in 56 
Boston schools 


U.S. 12th grade 
Negro males 
(EEOS) 


U.S. 12th grade 
Negro males 
(EEOS) 


12th grade Negro 
students and 12th 
grade white students 
(EEOS) 


6th grade white stu- 
dents in 471 schools 
and 6th grade 

Negro students in 
242 schools 


39 Chicago schools 


Equality of Educa- 
tional Opportunity 
survey (EEOS) 
U.S. sample 


EEOS U.S. sample 


5,284 6th grade 
students in 
Michigan 


School atten- 
dance, school 
holding power, 
reading achieve- 
ment, special 
school entrance 
examination 


Mathematics and 
reading achieve- 
ment test and a 
test of general 
academic ability 


Verbal ability 
test 


Verbal ability 
test scores 


Verbal ability 
test 


Reading ability 
attrition 


Verbal ability 
student/parent 
attitudes, grade 
aspirations 


Verbal ability 
student/parent 
attitudes. Grade 
aspirations, read- 
ing ability, math 
ability 

Reading ability, 
mathematics 
understanding, 


1. Pupils per classroom 

2. Student-staff ratio 

3. Attendance district 
enrollment 

4. Teachers’ employment 
status 

5. Teachers’ degree level 

6. Teachers’ experience 

7. Teacher turnover ratio 


1. Class size 

2. Ability grouping 

3. Level of teacher training 
4. Age of school building 
5. Expenditures per pupil 


1. Teachers’ verbal ability 

2. Science laboratory 
facilities 

3. Length of school year 


1. Teachers’ verbal ability 
2. Teachers’ salary 


1. Teachers’ verbal ability 
2. Teachers’ experience 


1. Building utilization 

2. Man years of teacher/ 
support staff devoted 

3. Student employment 

4. Specific vocational 
courses 


1. Teacher experience 


(for whites) 
1. Teacher verbal ability 
2. Teacher experience 
(for blacks) 
None reported 


1. School site size 
2. Building age 
3. % classrooms makeshift 
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Table 4-3 continued 


Study 
Author(s) 


Description of 
Sample 


Measure of Pupil 
Performance 
(School Output) 


Measure(s) of Effective 
School Service Component(s) 
(School Input) 


20. Tuckman 
(1971) 


21. Mayeske et al. 
(1972, 1973a, 
1973b) 


22. Boardman et al. 
(1973) 


23. Summers and 
Wolfe (1975) 


Current Population 
Survey Sample, 1001 
senior high schools 


EEOS U.S. sample 


Over 16,000 students 
in a subsample of 
EEOS U.S. sample 


1,896 students in 
Philadelphia elemen- 
tary, junior high, 
and senior high 
schools 


verbal facility 


Percent of stu- 
dents complet- 
ing high school, 
percent of stu- 


dents continuing 


education 


Expectation for 
excellence, atti- 
tude toward life, 


educational plans 


4. Library volumes 

5. Textbook supply 

6. Teachers' verbal ability 

7. Teachers' experience 

8. Teachers' job satisfaction 

9. School size (enrollment) 
10. Classrooms per 1,000 

students 

11. % of students transferring 


]. Teachers with ten years 
experience 

2. Master's degree (negative 
jn some equations) 


1. Teaching conditions 
2. Teacher race 
3. Teachers’ vocabulary score 


and desires, study 


habits, achieve- 
ment grade, per- 


cent of 12th grade 
graduates going on 
to college (by race), 


percent of 12th 
grade graduates 


going on to voca- 


tional training, 
percent of 10th 
grade boys who 


drop out of school 


Verbal achieve- 
ment, nonverbal 
achievement, 
reading achieve- 
ment, general 
information 
achievement 


Two- or three- 
year gain in 
reading 
achievement 
Scores 


1. Teachers vocabulary score 

2. Teacher/pupil ratio 

3. Teacher experience 

4. Number of teachers leaving 

5. Teachers’ perception of prob- 
lems with administration 

6. School policy of administer- 
ing tests 

7. School facilities 

8. Problems in school 


1. Class size 

2. School size 

3. Teacher experience 

4. Quality of teachers' college 


Source: Updated, corrected and adapt 


ed from Guthrie (1970), 


pp. 47-48. 
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from which many later studies have profited, was undertaken for the Educa- 
tional Testing Service by William G. Mollenkopf and S. Donald Melville (1956). 
The researchers selected 9,600 ninth grade students from 100 public schools and 
8,357 twelfth grade students from 106 public schools; the schools were selected 
from across the country. From answers to questionnaires administered to school 
principals, a list of 34 independent variables—including school, non-school, and 
peer influences—was constructed, These inputs (independent variables) were 
compared with a test specially designed by Educational Testing Service as the 
output (dependent variable).P 

Simple (Pearson) correlation techniques were used in this study to relate 
inputs to the specified components of output (vocabularly score, math score; 
science score, etc.).^ Of the school factors only one—library and supply expendi- 
tures—was consistently correlated with student achievement. And this variable 


od 
classroom atmosphere.’ 
ies, Goodman found the 


simplified. criptions that follow and the notation is thus 
©The seven individual test 
indices. 
dOthers have alluded to “environmental press,” “ 
ening atmosphere,” and so forth. 


Scores were eventually clustered into verbal and quantitative 


empathic understanding,” “nonthreat- 
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and his associates (1965) conducted a study of California school effectiveness 
for a state senate fact-finding committee. After controlling for student back- 
ground factors, they found a significant positive relationship between teacher 
salaries and student achievement. 

Perhaps the largest, most comprehensive, and most hotly debated study was 
published in 1966. Directed by James S. Coleman and his associates (1966), a 
study entitled Equality of Educational Opportunity attempted to determine the 
school and nonschool factors related to the achievement of over 600,000 stu- 
dents from coast to coast. Popularly known as the Coleman Report," the study 
found very little association between school factors (taken singly or collectively) 
in comparison to nonschool factors. Of the school factors, teachers' verbal 
ability seemed to be of most importance. 

The Coleman report has been criticized along three basic axes.° First, there is 
uncertainty as to whether the measurements used are sufficient for the task in- 
volved. Second, the handling of the data is thought by some to have been less 
than precise. Perhaps most damning, however, is the fact that many contend the 
manner by which the regression technique was used in effect stacked the cards 
against any strong showing by school factors. 

Basically, this latter argument is that stepwise multiple regression requires the 
Statistical assumption of independence of variables. Where such independence m 
not present (i.e., multicollinearity is present), the first variables to be entered (in 
this case nonschool factors) will appear most potent. In fact, the nonschool and 
School factors may be so nested within each other that their effects cannot be so 
arbitrarily separated. This criticism has been expounded most persuasively by 
Bowles and Levin (19682, 19686). 

Nonetheless, the Coleman Report stands as a benchmark for a number of 
reasons. More than any other study, it provided an impetus for theorists of all 
Orientations to become more involved in what had previously been a very spe- 
cialized and obscure branch of educational research—input-output analysis. Be- 
cause of its indictment of school effectiveness (whether that indictment was well 
founded or not) it also stimulated greater interest in other areas of school re- 
Search and functioning. А : 

By size of sample, number of variables, number of associates, wideness of dis- 
tribution, and amount of data, Coleman's work is also distinguished from most 
Other studies past and future. The study used data from and about 645,000 in- 
dividual students well distributed by type and location of school. Ninety-thres 
Separate input variables were delineated. The outcome measure consisted of ten 


*In addition to the criticisms made by Bowles and Levin (1968a, 1968b), see also a 


brief description of the controversy in Mood (1973). 
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scores, including uniquely a measure of nonverbal skill. To this day, researchers 
continue to fill professional journals with research based on the Coleman data 
base, albeit alternatively supporting and debunking Coleman's conclusions. By 
any standard, the Coleman work is destined to be considered a classic in the 
literature of educational assessment. 

As another aspect of the New York Quality Measurement Project, Herbert 
Keisling (1967) assessed input and output in varying kinds of school districts 
in New York! Keisling looked at large and small, urban and rural school sys- 
tems. Keisling found significant relationships between the cognitive output 
measures and student-teacher ratio and expenditures for books and supplies. 
However it must be stressed that the relationships were negative and the vari- 
ables had large coefficients. Keisling reports that none of the other variables 
was uniformly important. 

The research team of Jesse Burkhead, Thomas G. Fox, and John W. Holland 
(1967) were able to conduct a unified study of 39 Chicago schools, 22 Atlanta 
Schools, and a subsample of 177 schools from the original Project TALENT 
sample. Although the independent and dependent variables were not identical in 
all three substudies, there was sufficient similarity to compare like items. In 
Chicago and Atlanta, family income was positively related to reading and verbal 
skills respectively. Teacher experience and teacher salary, respectively, were both 
associated with positive outcomes. Using the Project TALENT sample, family in- 
come, teacher experience, and salary were significant positive variables. 

Martin T. Katzman (1968) examined data from 56 Boston elementary 
Schools. In addition to the typical input and output variables, Katzman also 
looked at student cultural advantage, degree of school overcrowding, attendance 
rate, school attrition, and size of School district. Results of overcrowding were 
not consistent, but economies of scale did appear in larger attendance area in 
terms of incremental reading ability and lessening of attrition, Teacher experi- 
ence variables seemed inconclusive, although level of teachers’ degrees was 
generally positive. 

Also looking at possible economies of scale in education was one of the auth- 
ors’ study (Cohn, 1968) of 377 Iowa high schools, the overwhelming majority 
of which constituted the only public secondary schools in their districts. In addi- 
tion to determinging the most efficient size for school districts, a significant 
negative relationship was found between the output measure (increment in 
Scores on the Iowa Tests of Educational Development), and two inputs: (1) 
number of teacher’s college credit hours, and (2) number of discrete teaching 


fThe Keisling work was originally Ieported in a 1965 unpublished doctoral dissertation. 
Variations on the study appear in Keisling (1969). A somewhat different New York sample 
is analyzed in Keisling (1970). The results of all these efforts are discussed here collectively- 
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assignments per teacher. A significant positive relation was found between out- 
put and median teacher salary. 

Richard Raymond (1968) in an ex post facto study examined the precollege 
educational backgrounds of in-state students who entered West Virginia Univer- 
sity. Because of the time frame involved, Raymond used a very different set of 
criterion measures. He used college freshman grades along with composite scores 
on the American College Test (ACT) as the output measure. By county of pre- 
college attendance, he then compared the output with school inputs. He de- 
rived nonschool variables from 1960 census data for the various West Virginia 
counties. Of the school components, he found teacher salary positively signifi- 
cant, with the student's elementary school teacher salary being the most potent 
predicator. 

In one of the earliest studies to look specifically at whether school and non- 
School inputs might have a differential effect on blacks and whites, Hanushek 
(1968; see also Hanushek, 1972) examined the records of black and white sixth 
grade students in the northeastern and upper midwestern areas of the country. 
Hanushek’s sample intentionally included students in predominantly white as 
well as predominantly black school situations. In this research, separate regres- 
sions were run for the black and the white samples. The data used were all drawn 
from the original Coleman data files for the geographical areas being studied. 

Hanushek looked at a wide array of home and school variables including 
Parents’ education, preschool exposure, racial mix, and school location. Teacher 
experience and teacher verbal ability were also measured. Hanushek found that 
basically the same input variables were operative for both black and white 
students, He found the two teacher variables to be significantly positive for both 
black and white. : 

Samuel Bowles (1969) has also attempted to build a true educational produc- 
tion function using Project TALENT and Coleman Report data. The sample for 
this research consisted of black students who participated in the two national 
Samples in either 1960 or 1965. While a great deal of emphasis was placed on 
nonschool variables, negative school components included large class size and age 
of facilities, Elsewhere, Bowles (1970) also stresses the importance of facilities 
in general, and science facilities in particular. 

Bowles, along with Henry M. Levin, had been among the most vocal and per- 
Sistent of critics of the methodology and conclusions of the Coleman Report, 
as was pointed out earlier in this chapter. Their basic disagreement has appeared 
in a number of places (Bowles and Levin, 19682, 1968b; and Bowles, 1970). 
In 1968 the two authors (Bowles and Levin, 1968b) reported results of a re- 
analysis of the Coleman data and found a significant positive influence of teach- 
ет verbal ability on both black and white student performance. Again, they also 
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found teacher salaries and availability of adequate facilities (particularly science) 
to be positively related to achievement. 

Thomas G. Fox, who earlier had collaborated with Burkhead and Holland 
(Burkhead, Fox, and Holland, 1967), reported again on an analysis of his 39 
Chicago schools in a separate paper (Fox, 1969). Using two of his original 
output measures—reading scores and school attrition rate—he constructed a 
somewhat different set of school input measures, including school building 
utilization rate, capacity of building cross-footed by age, book expenditures, 
man years of teacher and support staff time committed to the school and stu- 
dent time in specific vocational courses, and the employment status of students. 
These inputs reflected variables that had not been in the forefront of research 
on educational effectiveness. While book expenditures and building capacity by 
age were not significant, the other elements were found to be variously positive. 
The research shed some new light on additional variables of potential influence. 
Moreover, Fox's study presents the first simultaneous-equation model of educa- 
tional production. 

In a second study by Eric Hanushek (1970), 1,000 students in a single school 
district in California are studied. This research is distinguished from all those 
previously discussed because the entire analysis proceeded from data at the indi- 
vidual student level of aggregation. In order to carry the procedure forward, it 
was necessary for Hanushek to delete all cases in which any information was 
missing. For example, if a student moved into or out of the system, and charac- 
teristics of all previous and current teachers were not available, the case was re- 
moved. This requirement dropped the sample size from nearly 2,500 to just over 
1,000 subjects. 

Since the most visible minority in the school system was Mexican-Americans, 
Hanushek compared these students with whites. He stratified the two groups 
into four subgroups depending on whether the student's father was in a manual 
or nonmanual occupation. In terms of School factors, it is interesting to note 
that teacher experience and teacher education level were found not to be sig- 
nificantly related to the output measure (Scholastic Aptitude Test scores) for 
any of the groups. Since this study is the first to operate at the individual stu- 
dent level, the lack of relationship of the output to the two most commonly 
used school input factors must cause a serious reevaluation of those studies 
which have shown these variables to be positive and significant. 

Henry M. Levin (1970) presents another study that attempted to use the 
Coleman data pool while avoiding some of the methodological problems that 
plagued the original Coleman analysis. As the output measures Levin specified, 
in addition to verbal score, student and parent attitudes, and student grade as- 
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pirations. In the two stage least squares (TSLS) regressions, only teacher experi- 
ence was positive and significant in terms of the verbal ability output. 

Appearing in the same volume in which the above Levin study appeared is a 
report by Stephan Michelson (1970), also using the Coleman data. Michelson 
used the same dependent variables as Levin, but added test scores for reading 
and mathematics as well as verbal ability. Independent variables were similar 
to Levin's. Stratifying the sample on race, Michelson used both single and simul- 
taneous equation systems. For whites, some school inputs were consistently 
positive using the TSLS approach for verbal ability. These include teacher verbal 
ability and experience. Results are less consistent for other outputs. No signifi- 
cant relationships are reported for blacks. 

Another view of possible reinterpretation of the Coleman conclusions is pre- 
sented in a study by James W. Guthrie and his associates (1971). Guthrie's team 
looked at the Coleman data for the state of Michigan. While the sample con- 
tained both blacks and whites, the group was not stratified by race, but rather 
by socioeconomic status regardless of race. The authors report a series of school 
inputs positively related to achievement under the general categories of facilities, 
materials, teacher characteristics, and peer environment. Significant teacher varia- 
bles included verbal ability, experience, and job satisfaction. 

Another study appearing in the same year (Tuckman, 1971) made use of a 
Current Population Survey of 10,700 elementary and secondary schools. Tuck- 
man chose a subsample of 1,001 senior high schools. For that sample, data were 
available on two inputs: percentage of teachers with ten or more years of ex- 
perience, and percentage of teachers holding at least a master's degree. Addi- 
tional inputs included education of parents, sex, race, region, and the proportion 
of students who were behind in grade. On the output side, five measures were 
used: percentage of students completing high school, percentage continuing to 
any higher education, percentage attending a four-year college, percentage at- 
tending a two-year college, and percentage going on to other educational insti- 
tutions. 

The novelty of the Tuckman study is his attempt to study the effect of inter- 
action between school and nonschool variables. His analysis indicates that the 
output effects of the school inputs, based on the typical linear regression analy- 
sis, differ from those obtained through the interactive model. Since very little is 
known about such interactive influences, studies of this nature are clearly de- 
sirable. However, when studies involve a large number of variables—as do most of 


ELevin provides additional results in a recent paper (Levin, 1974) in which he argues that 
failure to incorporate in educational production function analyses all the relevant outputs 
might seriously distort the production coefficients and lead to erroneous policy implica- 


tions. 
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the large surveys described herein—the number of interactive combinations be- 
comes almost astronomical, and a meaningful analysis of interaction is almost 
entirely out of question. 

After a span of some years, another work has caught the public eye and gal- 
vanized public opinion. Perhaps destined to be as controversial as the Coleman 
Report, the work by Jencks and his associates (1972) sees the appropriate out- 
come of schooling not as demonstrated student achievement, but as equality of 
opportunity. In this regard they find the school deficient. 


[It is our contention] that differences between schools have rather trivial 
long term effects, and that-eliminating differences between schools would 
do almost nothing to make adults more nearly equal. Even eliminating dif- 
ferences in the amount of Schooling people get would do relatively little to 
make adults more nearly equal. If this is true, schools ought to be judged 
largely by their short term effects. This does not, in our view, weaken the 
case for distributing school resources and opportunities equally. But it 
means that this case is no different from the case for making the distribu- 


tion of public parks, trash collection, or other public services equal (pp. 
16-17). 


Jencks contends that the main value of the school is its immediate effects as a 
milieu. He finds this to be no small task in itself, although others continue to 
suggest the need for a more long term educational output to society. 
Considerable work has been underway for some years in the U.S. Office of 
Education to reanalyze the massive data supplied by the Equality of Educa- 
tional Opportunity Survey (EEOS). The Coleman Report was the first published 
document regarding the Survey, but certainly not the last, necessarily, nor even 
the most significant. As Mood (1973) points out, the reanalyses by Mayeske and 
his colleagues “һауе viewed the survey information far more deeply and expertly 
than was possible in the limited time available to prepare the original [Coleman] 


is, and (2) the Mayeske reports have used more 
sophisticated statistical techniques in their analysis. 


The first Mayeske report (1972) is focused on the schools as a unit of analy- 
Sis. Within-school variations are ignored. The main technique for analysis is 
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termed *commonality analysis," which is used to divide the squared multiple 
correlation coefficient into portions of the variance uniquely explained by each 
variable (or sets of variables) in a multiple regression equation and the propor- 
tion of variance commonly explained by two or more (sets of) variables. For 
example, if the outcome (dependent variable) is designated by X, school factors 
by 5 and nonschool factors by В (independent variables), then the analysis рго- 


vides an equation such as: 
R? (S,B) = U(S) + C(S,B) + U(B) 


where R?(S,B) is the squared multiple correlation coefficient, derived by regres- 
sing X on S and В, U(S) and U(B) аге, respectively, the unique variances attribu- 
ted to S and B, whereas C(S,B) is the residual variance of X explained by S and 
B together (exclusive of any error term). 

The study employs factor analysis to generate indices of school and non- 
school variables. The latter were then studied in relation to a number of school 
outcomes, including achievement, students’ expectations for excellence, attitude 
on life, educational desires and plans, and study habits. The major finding was 
that, on the whole, the unique contribution of school factors to explaining 
variations in outcomes was extremely small. At the same time, the common уагі- 


ance may be quite large, indicating the likelihood of strong interactive effect of 


the school and nonschool variables (confirming Tuckman’s analysis described 


above). 
A number of other results deserve mention here: 


1. A high correlation was found for schools among the various outcomes. “Іп 


other words, favorable performances tend to facilitate and reinforce one 


another” (p. 111). 


2. Among school variables, those related e ; 
ct on outcomes, both in terms of the unique variance ex- 


to a school's personnel were shown to 


have greatest effe 
plained and the size of the commonality factor. о 
3. Expenditures, school facilities, and pupil programs and policies are generally 
unimportant, measured both by the unique and common variance explained. 
4. “Teacher attributes highly related to school outcomes were thoas reflecting 
a teacher’s experiences in racially imbalanced educational settings (p. 113). 
The authors cite the typical attendance of nonwhite teachers in predomi- 
nantly nonwhite institutions (which are deemed less desirable) as a possible 


cause for lower output by students exposed to such teachers. 
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A major general conclusion of the report echoes conclusions reached by Cole- 
man and his associates as well as by Jencks and other critics of the educational 
system: 


For both students and teachers, the American educational system reflects 
the structure of American society. It, therefore, tends to perpetuate and 
even further increase the differential learning experiences that students 
bring to the educational setting by virtue of their birth (p. 113). 


The second Mayeske report (19732) focused on student achievement. Two of 
the main findings should be mentioned. 


1. “There were indications that the color-caste aspects of the social structure, as 
represented by Racial-Ethnic Group Membership, had a greater impact on 
achievement in the south, and would consequently be more difficult to over- 
come by means of educationally related childrearing activities" (p. 147). 

2. The unique contribution of school factors to achievement was found to be 
quite low (4 percent). The effect of the school variables was thus seen to 
operate mainly through their interaction with variables representing back- 
ground (socioeconomic status, family structure, racial-ethnic group member- 
Ship) and family process (expectations, aspirations, beliefs regarding life, 
stimulation and support). 


The third Mayeske report (1973b) is concerned with an explanation of vari- 
ance in students' attitudes toward life. Most of the material in the report deals 
with nonschool factors, so that the conclusions, while quite interesting, are not 
directly relevant to this volume. However, the authors conclude that a set of. 
school inputs consisting of five teaching staff attributes did not show any inde- 
pendent influence on attitudes, but that the role of these variables was “сот- 
pletely confounded with that of the five student body variables" employed by 
the authors (p. 84). It is also noted that the association between school variables 
and attitudes was greater in the south than in the north; and finally, that there 
is once more considerable commonality with socioeconomic status, home back- 
ground, family process, and achievement. 

Another study was presented during the December 1973 meeting of the 
American Statistical Association in New York City (Boardman et al., 1973). The 
authors of the study report on the results of a simultaneous-equation model, 
where the endogenous (dependent) variables are various achievement measures 
obtained by the EEO Survey. They include verbal, nonverbal, mathematics, read- 
ing, and general information achievement. The set of explanatory variables 
include a variety of peer, environmental, and school related variables. 
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It is not clear why the authors chose the particular specification of the struc- 
tural equations; further, the paper is very concise, so that it is quite difficult to 
evaluate the results very closely. Nevertheless, the study provides a number of 
interesting conclusions with regard to the impact of school variables. The first, 
and most important, significant variable is the average teachers' verbal score. 
The results here confirm previous results by Levin (1970), Michelson (1970), 
and Bowles (1970). Interestingly, the teacher-pupil ratio is “positively and sig- 
nificantly associated with each of the various measures of achievement” (p. 64), 
a finding that makes a great deal of sense yet one that, to date, most studies have 
failed to support. 

Another significant school outcome is experience. The authors used a qua- 
dratic specification for that variable, indicating that the first few years of experi- 
ence are negatively associated with achievement, but that as more experience is 
gained, the relation becomes positive. This is in contrast to the popular belief 
that experience is positively related to productivity during the first few years, 
after which the effect becomes zero or even negative. 

A fourth significant factor is the number of teachers leaving. The positive 
correlation with verbal, nonverbal, and reading achievement may be explained 
by a process of “natural selection” whereby “dedicated teachers tend to be the 
ones who remain on the job . . . while those who really were not interested in 
this profession drop ош” (p. 65). Also, “the perception on the part of teachers 
of the lack of effective administrative leadership is positively related to all 
measures of achievement" (p. 65). The authors explain this surprising result as 
follows: “Since the mean of this variable is low, one might speculate that only 
the better and more perceptive teachers are able to recognize such problems 
and these teachers perform well in any event" (p. 65). 

It was also found that achievement tends to be higher in schools in which the 
administration of IQ and achievement tests is a matter of school policy. The 
authors do not elaborate, but it just might be that when such tests are adminis- 
tered year after year, and when schools pay attention to such results, teachers 
and pupils gain a certain degree of expertise in answering the questions (for 
students) and coaching students on the exam materials (for teachers). In conse- 
quence, this variable might be more appropriately considered as a control device 


rather than as a school factor. M 
Two other measures significantly related to achievement are school facilities 


and existence of problems in the school. As expected (though typically not 
found to be significant in other studies), the coefficient of facilities is positive, 
whereas the coefficient for the problems in schools variable is negative. 

It should also be mentioned that factor analysis conducted by the authors 
indicates that all the achievement measures describe essentially the same charac- 
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teristic, so that a single-equation analysis based upon only one of the measures, 
or an index of the five measures (as was done by Mayeske et al., 1972), would 
probably result in similar conclusions. However, the case for simultaneous- 
equation analysis is not seriously challenged by this finding, as the study was 
concerned exclusively with cognitive achievement, leaving aside attitudes and 
other outputs. 

Of considerable interest, finally, is the recently published study of Phila- 
delphia public schools by Summers and Wolfe (1975). Like one of Hanushek's 
studies, this one too attempted to identify school resources, especially teachers, 
with the students who are directly affected by such resources. In addition, the 
Philadelphia study employed a longitudinal measure of output—growth in 
achievement scores over a period of two years for junior high school students 
and three years each for elementary and senior high school students. Another 
important characteristic of the study is its endeavor to study the effect of school 
resources on various student groups—disaggregated by race, sex, ability, and 
other variables. 

The results of the study indicate that some school factors are significant, in- 
cluding class and school size, teacher experience, and quality of degree granting 
institutions from which teachers graduate. Interestingly enough, these factors 
do not affect all students in a like manner: for example, class size appears to 


have an effect on elementary and senior high schools but not on junior high 
schools. The authors conclude that: 


In short, some school inputs can heighten student achievement: classes 
over certain sizes reduce learning; smaller elementary and senior high 
schools increase it. Net output may be increased by targeting teacher ex- 
perience and higher rated college background to the appropriate students. 
Moreover, some of these school inputs can help offset the initial learning 
handicaps of race, income, and capability (p. 14). 


Additional analysis indicates that the student mix—both in terms of racial 
composition and ability levels—is likely to affect learning in some cases. This, 
once again, implies a role for school management in identifying the appropriate 
mixes for increasing output gains. The authors also advocate structuring teach- 
ers’ salaries on the basis of the teachers’ productive characteristics, a suggestion 


proposed by one of the present authors on several occasions (Cohn, 1970; 1972, 
pp. 293-297; and 1973). 


WHERE DO WE STAND NOW? 


The lack of consistent results displayed in the preceding section should not sur- 
prise anyone. Only in recent years has educational research begun to receive the 
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attention it deserves, and even more recently has the development of an educa- 
tional production function come into its own. It may therefore be unrealistic 
to expect uniform results across such idiosyncratic and situational conditions as 
exist in American education at this point. 

Nonetheless, it is unsettling to see the variation in results of input-output 
analyses as they have been reported in this chapter and summarized above in 
Table 4-3. While some school components, such as teacher experience, salary, 
and facilities have been shown to be significant positive influences in a number 
of places and at a number of times, not all studies find this to be so. 

Averch and his associates are forced to conclude the following after reviewing 


existing studies: 


Research has not identified a variant of the existing system that is 
consistently related to students' educational outcomes. 


The term “а variant of the existing system" is used to describe the broad 
range of alternative educational practices that have been reviewed above. 
We specifically include changes in school resources, processes, organiza- 


tions, and aggregate levels of funding. 


We must emphasize that we are not suggesting that nothing makes a dif- 
ference, or that nothing "works." Rather, we are saying that research has 
found nothing that consistently and unambiguously makes a difference in 
students’ outcomes. The literature contains numerous examples of educa- 
tional practices that seem to have significantly affected students’ out- 


comes, 


The problem is that there are invariably other studies, similar in approach 
and method, that find the same educational practice to be ineffective. And 
we have no dlear idea of why a practice that seems to be effective in one 


case is apparently ineffective in another. 


We must also emphasize that we are not saying that school does not affect 
student outcomes. We have little knowledge of what student A 
would be were students not to attend school at all. Educational researc! 

ting system and tells us nothing about where 


iants of the exis 
focuses on variants о 154-155).^ 


we might be without the system at all (pp. 


this score. A study by Green et al. (1964) compared test 
hooling was interrupted age sore уе ША рена 
imi i nomic and locational backgrounds. т 
2e x ee pes ee үне wei “It was found that the children whose schooling 
had База. творе exhibited severe educational retardation, pi ӨЛІ € 
closely related to school curriculums such as spelling and Wa Nem. Res 
the scores of these children were 15 to 30 points lower than those јасеп 


county who had continued іп school" (Mayeske et al., 1972, p. 113). 


hThere exists some evidence on 
performances by children whose sc 
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The answer lies not in giving up promising lines of research, but rather in refining 
measures of cognitive ability, finding ways to measure noncognitive functioning 
more adequately, better data collection, and more sophisticated data manipula- 
tion and analysis. 

In a comprehensive synthesis of available studies of educational effectiveness 
undertaken for the New York State Education Department, Heim (1972) was 
able to present a slightly less ambiguous total view. Since most of the existing 
studies dealt with cognitive outputs, the preponderance of Heim's attention was 
upon such outcomes. He was particularly interested in those inputs that are 
amenable to policy manipulation, rather than those personal and demographic 
variables that cannot be changed by, or are not under the control of educational 
policy makers. 

With this frame of reference in mind he indicated the “ох scores" of those 
policy manipulable inputs that have been tested against cognitive outputs. Heim 
pointed out that five variables have been studied frequently, namely: (1) teacher 
degree status, (2) teacher experience, (3) interaction of noncognitive inputs and 
cognitive outputs, (4) class size (or student-teacher ratio), and (5) availability of 
special support staff. 

Collapsed here into a single portrait, Heim paints the following in wide brush 
strokes: 


In 83 percent of the studies reviewed, it was found that . . , the higher the 
average level of teacher education in the school, the more impressive was 
student performance. .. . Teacher experience is also commonly thought to 
influence student performance. However, the evidence is substantially less 
conclusive. . . . In the 23 studies reviewed, teacher experience was found 
to be significantly related to student performance only 57 percent of the 
time. . . . Persuasive evidence was reviewed which indicates that, in part, 
student achievement in the intellectual skills area is related to the level of a 
student's development іп the noncognitive domain. , . . There seems to be 
little evidence to suggest that, within fairly broad limits class size (or its 
most often used proxy, teacher-pupil ratio) has any general effect upon 
cognitive or noncognitive school outputs. . . . Overall, the amount of 
special staff per pupil was found to have a significant effect on student 
achievement in fewer than half of the studies in which its effect was tested 
(pp. 98-102).' 


Again, the reader is cautioned not to assume that these variables are inoperative 
generally. It is rather stated that on the whole, only one out of five commonly 
tested school components is measured and shows positive impact consistently 
across different students in different settings. 


igee also Heim (1973). 
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Educational psychologists would readily point out that human development 
and learning are hypothetical constructs par excellence: they cannot be mea- 
sured directly, but can only be inferred from a change in performance over time. 
A person in isolation would change over time through the sheer force of physical 
maturation. When one compounds complexity of the process by replacing isola- 
tion with the effects of socialization, physical and social deprivation, and a host 
of other potential factors, the relationship among inputs and outputs can be- 
come quite tenuous. The dilemma is exascerbated by the need to make compari- 
sons not only of a given individual over time, but of different individuals with 
different hereditary and environmental interfaces in terms of a process that 
typically consumes not fewer than twelve calendar years, and commonly longer. 

While the timid might be given pause by the rich diversity of the human con- 
dition, drawing back from the effort is destined to only delay its solution. The 
Solution is neither as simplistic as many would have hoped nor as insoluble as 
others would suggest. What is needed is the willingness to take small and tenta- 
tive stpes, to consolidate knowledge of past successes and failures, and to con- 
tinually refine both the instruments and the processes. It is this challenge toward 


which the present volume is directed. 


CONCLUDING COMMENTS 


preceding chapters establish the basic 
secondary education. In the following 
rical examination of input and 


The materials provided in this and the 
framework for input-output analysis in 
Chapters our attention is focused on an empi 
Output data collected for 53 Pennsylvania secondary schools during 1971-72. 
The set of data to be analyzed here is significant because it provides—perhaps 
for the first time—an opportunity to examine within a single input-output frame- 
work numerous school and nonschool inputs, as well as a variety of outputs, 
including not only test scores on basic skills but also attitudinal data and infor- 
mation on vocational development and creative output and potential. And while 
Whatever conclusions that emerge apply at best only to the set of schools from 
Which data were drawn, this analysis should form an interesting example of 
input-output analysis that can be adapted, modified, and implemented in other 


settings. 


Chapter Five 


The Pennsylvania Plan 


Гоу ушу 4 


Since most of the data used in this study were accumulated by the Division of 
Educational Quality Assessment, Pennsylvania Department of Education, it is 
desirable to provide some information about the genesis, character, and develop- 
ment of the Pennsylvania Educational Quality Assessment (EQA) Program, also 


known as the Pennsylvania Plan.” 


PURPOSES OF THE PLAN 


On August 8, 1963, the Pennsylvania legislature passed the School Reorganiza- 


tion Act (Act 299). Section 290.1 of the act directed the State Board of Educa- 
tion to 


veloped an evaluation procedure designed to 
acy and efficiency of the educational pro- 
Commonwealth. The evaluation 
ests measuring the achievements 


-.. develop or cause to be de 
measure objectively the adequ 
grams offered by the public schools of the 


procedure to be developed shall include t 
and performance of students pursuing all of the various subjects and 


courses comprising the curricula. The evaluation procedure shall be so con- 
Structed and developed as to provide each school district with relevant 
comparative data to enable directors and administrators to more readily 
appraise the educational performance and to effectuate without delay the 
strengthening of the district's educational program. Tests developed under 
the authority of this section to be administered to pupils shall be used for 
the purpose of providing a uniform evaluation of each school district and 
the other purposes set forth in this subdivision. The state Board of Educa- 


This chapter is based on Educational Quality Assessment in Pennsylvania (1973). АП 


Page numbers refer to that publication. 
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tion shall devise performance standards upon completion of the evaluation 
procedure required by this section (p. 6). 


The need for such an evaluation was apparent when, in the hearings preceding 
the enactment of the Reorganization Act, both proponents and opponents of 
the measure relied on the elusive term *quality education" for defense of their 
respective positions. The obvious question then arose: "Just what is quality 
education?" 

The legislation emphasizes the use of the data by school administrators in 
such a manner that the educational decision making process may be improved. 


THE TEN GOALS OF QUALITY EDUCATION 


In an effort to develop a comprehensive instrument that would be capable of 
satisfying the desire to measure educational quality, the Pennsylvania Depart- 
ment of Education has established the Ten Goals of Quality Education. The 
choice of the ten goals was made after consultation with “civic and professional 
leaders from throughout the state" (p. 7). These ten goals are summarized in 
Table 5-1. 


Table 5-1. Pennsylvania's Ten Goals of Quality Education 


Quality education should: 
I. Help every child acquire the greatest possible understanding of himself or herself and 
appreciation of his or her worthiness as a member of society. 


П. Help every child acquire understanding and appreciation of persons belonging to other 
social, cultural, and ethnic groups. 


П. Help every child acquire, to the fullest possible extent, mastery of the basic skills in 
the use of words and numbers. 

IV. Help every child acquire a positive attitude toward the learning process. 

V. Help every child acquire the habits and attitudes associated with responsible 

citizenship. 

VI. Help every child acquire good health habits and an understanding of the conditions 
necessary for maintaining of physical and emotional well-being. 

VII. Give every child opportunity and encouragement to be creative in one or more fields 
of endeavor. 


УШ. Help every child understand the opportunities open to him or her to prepare for a 
productive life and help each child to take full advantage of these opportunities. 


IX. Help every child to understand and appreciate as much as possible of human 
achievement in the natural sciences, the social sciences, and the humanities and the 
arts. 


X. Help every child to prepare for a world of rapid change and unforseeable demands in 
which continuing education throughout adult life should be a normal expectation. 


Source: Educational Quality Assessment in Pennsylvania (1973), p. 5. 
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It is clear that the Pennsylvania Plan provides for a measurement of quality 
far different from the widespread use of expenditure data, quality of inputs, or 
merely achievement tests. The plan recognizes the importance of such goals as 
attitude modification (regarding such areas as citizenship, race relations, drug 
usage, and the learning process), vocational development, and creative output 
and potential.> 


DATA COLLECTION 


The process of data collection has undergone some changes since the inception 
of the plan. In the first phase (Fall 1968), the fifth and eleventh grades in 100 
Schools were selected throughout the state of Pennsylvania for the purpose of 
testing the reliability and content validity of the measures developed to assess 
attainment of the ten goals. 

In Phase II of the plan (Fall 1969) “а stratified random sample of some 
37,000 students in grades five and eleven in 428 different schools" was em- 


ployed (p. 7). The data were gathered mainly for the purpose of studying the 


meaning of the numerical scores obtained for the various goals so that an inter- 


pretation of results could be provided to schools in subsequent testing. 

Phase III marked the beginning of actual assessment. Beginning in Fall 1970, 
à number of schools have been assessed each year on the basis of voluntary 
participation. The samples for the period 1970-73 are summarized in Table 5-2. 


Currently, all schools are required by law to participate once every three years. 


In addition to testing fifth and eleventh grades, assessment will also be available 


for seventh, eighth, and ninth grades to satisfy the needs of middle and junior 


high schools. 


ADMINISTRATION 

To avoid what would amount to а monumental—and expensive—undertaking, 
local school districts must themselves administer the assessment. Data are gath- 
teachers, and administrators. These data are sent to Harris- 


ered fi i 
rom pupils, a on file, analysis of each school is 


burg, where together with additional dat 
carried out. 


USE OF THE DATA 


Each school receives a School Report containing the following information: 


b Additional information about the dimensions and measurement of the ten goals is con- 


tainted in Appendix Table А-1. 


54 Input-Output Analysis in Public Education 


Table 5-2. EQA Samples, 1970 to 1973 


Number of Number of Number of 

Year districts schools Grade level students 
Fall 1970-71 110 444 5 26,000 
89 1 24,000 
Fall 1971-72 49 172 5 11,000 
53 11 12,000 
Fall 1972-73 84 382 5 28,000 
90 и 29,000 
$ргїпр 1972-73 55 63 y 15,650 
96 148 9 34,850 


Source: Educational Quality Assessment in Pennsylvania (1973), p. 8. 


(i) The school’s standing in the state on each of the Ten Goals of Quality Edu- 
cation. 

(ii) The school’s standing relative to schools operating with a similar set of 
resources—for example, the Appalachia school with limited resources is not 
expected to match the achievement of an affluent suburban school with a 
vastly different student body, faculty, and financial support. 

(iii) The school’s standing on each of the different resources (as many as 44) 
which are employed in setting the “level of expectation" cited in (ii) that 
“similar” schools are meeting. 

(iv) How many high and low student scores there were which contributed to 
the average score—school score—cited in (i). Student replies to selected 


items. 

or 
Student replies to selected groups of items (subscales on each goal) (pp- 
10-11). 


It should be noted that the unit of analysis is the school. Data concerning 
individual students are not released, and in any event, students provide anony- 
mous replies so that identification of individual replies is impossible. The relative 
standing on each of the ten goals is provided through the use of multiple regres- 
sion analysis, in which each school's score is predicted on the basis of its stand- 
ing on a number of explanatory variables? Each school, then, can compare its 
actual standing with the predictive (relative) standing. The School Report also 
provides confidence intervals for the predicted scores. 


©$ее Campbell et al (1971). Many of the measures used as explanatory variables are 
described in Appendix Tables A-2 and A-3. 


The Pennsylvania Plan 55 


The EQA division claims that the results of the assessment program have 
induced a number of changes in the schools, including the following: 


. Faculty and students human relations meetings conducted. 

. Improved the *humanness" of the secondary faculty. 

. Changed emphasis in guidance, particularly in areas of self-esteem. 
Revision of social studies curriculum. 

Increased cultural program with ESEA Title I funds. 

. Concentration on knowledge of differing occupations. 

. Basic changes in reading and math program. 

. Health education program changed. 

. Teacher awareness of ten goals (p. 15). 


© о з с ROC ÉD — 


CONCLUDING COMMENTS 


The nature of the Pennsylvania Plan and the data collected provide a fertile 
ground for further input-output analysis of secondary schools. For the purposes 
at hand, data from the 1971-72 survey for 53 secondary schools have been 
combined with additional data collected by Kuhns (1972). The analysis here, 
moreover, will go beyond the School Report, providing additional management 


information to affected schools. 


Chapter Six 


Production Functions for Pennsylvania 
Secondary Schools 


The need to employ a multidimensional set of educational outputs is widely rec- 
ognized. We have seen that a few attempts have been made to study educational 
production processes in the context of a simultaneous-equations system in which 
Several educational outputs interact. The present chapter attempts to provide 
additional information about the input-output process by estimating a simultan- 
€ous-equation system of Pennsylvania secondary schools. 

The present study has both advantages and drawbacks in comparison with 
previous studies. On the one hand we have the most extensive list of inputs and 
Outputs (especially the latter) ever analyzed in a simultaneous-equation context. 
On the other hand we were not able to trace the data to the individual students 
and were thus forced to employ the school as the unit of analysis. Moreover, the 
results are based on an extremely small sample of only 53 secondary schools. 
We recognize these (and other) limitations of our data base, and will attempt to 
take them into account in the discussion of any implications of the present 
Study. At the same time, the study's emphasis on manipulative inputs affords a 
discussion of the possibilities school management may have in improving oper- 
ating efficiency—provided, of course, that our results are replicated and prove 


reasonably consistent across time and space. 


THE DATA 


he output and input variables for 53 Pennsyl- 
The output data are based on tests 
de, whereas the input data are, in 
Fox (1971), and Boardman et al. 


The data for the study consist of t 
Vania secondary schools in the fall of 1971. 
administered to students in the eleventh gra 


ате list includes Levin (1970), Michelson (1970), 
(1973), 
57 
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part, related to the entire school district, the entire high school, a portion of the 
high school, or the eleventh graders. Since the unit of observation for the ри 
variables changes from one variable to the next, some problems of interpretation 
clearly arise. On the other hand, if the eleventh grade students can be considered 
to be representative of the secondary school students in the entire high school 
or the district, the weight of this problem is reduced. In any event, we were con- 
strained by the availability of data, and had to make the best of available infor- 
mation. 

Some of the input variables were collected by Kuhns (1972) to supplement 
the data collected by the Pennsylvania Department of Education (PDE). These 
additional input variables comprise the majority of what we have called manipu- 
lative inputs, in line with a theoretical analysis presented elsewhere (Cohn, 1971). 

The basic data used here are described in a summary form in Tables 6-1 and 
6-2. (The variables are defined or described in more detail in Appendix Tables 
A-1 through A-4.) It should be noted that the list of input variables used here 
is only a subset of the PDE set since, as will be explained below, we have made 
use of principal components analysis to compress the remaining variables into a 
set of four socioeconomic variables, designated by SEFAC 1, SEFAC 2, SEFAC 
3, and SEFAC 4. A brief description of the variables, by alphabetical order of 
the acronyms used, is provided in the Glossary. 


THE MODEL g 
The specification of educational production functions has been described in 
some detail in the preceding chapters, therefore the discussion here will presume 


Table 6-1. Output Variables: Definitions, Means, and Standard Deviations 


Standard 

Output Acronym Description® Mean Deviation 
1 GOALI Self Concept 89.41 1.38 
2 GOAL II Understanding Others 90.74 1.45 
3 GOAL Шу Verbal Basic Skills 16.08 1:35 
4 GOAL III-m Mathematical Basic Skills 18.24 1.30 
5 GOAL IV Interest in School 90.97 3.02 
6 GOAL V Citizenship 163.43 4.88 
7 GOAL УІ Health Habits 119.58 2.75 
8 GOAL VII-p Creativity Potential 60.74 1.14 
9 GOAL VII-o Creativity Output 137.72 3.30 
10 GOAL VIII Vocational Development 83.12 0.83 

11 GOAL IX Appreciation of Human 

Accomplishments 153.93 3.25 
12 GOAL X Preparation for Change 106.15 2.23 


ЗЕог a more detailed description consult Appendix Table А-1. 
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Table 6-2. Input Variables: Definitions, Means, and Standard Deviations 


Acronym Description" Standard 
iption Mean Deviation 

LIBRARY Accessibility of library 4.37 0.31 
TPPOS Teacher's number of years in present 

position 4.78 0.50 
TCOLLEGE Type of college from which teacher graduated 2.39 0.13 
TLOCALE Locale where teachers graduated from high 

school 4.31 0.16 
TSTABL Locale in which teachers spent most of their lives 4.40 0.19 
TMEDUC Educational level of teacher's mother 3.74 0.38 
REACTL Perception of actual characteristics influencing 

professional recognition 3.67 0.74 
RECIDEA Perception of ideal characteristics influencing 

professional recognition 1.70 0.26 
TCAREER Teacher career aspirations 7.24 0.69 
TSATISF Teacher satisfaction 19.89 1.09 
DISCREP Difference between real and ideal influences 

on educational process 4.74 0.52 
CLPRACT Teacher classroom practices 38.09 1.38 
TSALARY Teacher's salary 8205.66 562.50 
TEXPER Teacher's teaching experience 11.04 2.68 
TEDUC Teacher's education 4.75 0.29 
STAFFP Instructional personnel/pupil 0.05 0.0006 
BOOKSP Library books/pupil 10.87 3.68 
GUIDANCE Counselors/pupil 0.002 0.0005 
INNOVATE School usage of innovations 33.55 6.85 
EFFORT Property Taxes/Market Value 23.79 3.41 
ADA Average daily attendance 932.32 346.19 
сис Curriculum units/grade 23.92 7.45 
PRCO Preparation coefficient (teacher specialization) 0.50 0.09 
Trop Teacher load 20.05 1.85 
esiz Class size 24.29 5.61 
AEE Average extracurricular expenditure/pupil 66.47 21.67 
BRAT Ratio of actual enrollment to building 

capacity 1.08 0.23 
AMAN Administrative man hovrs/pupil 3.95 1.93 
AXMAN Auxiliary man hours/pupil 8.02 2.65 
SFRAT Student/academic faculty ratio 30.40 6.48 
PSUP Paraprofessional support 36.08 70.41 


"For a more detailed description consult appendix Tables A-2 through A-4. 
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that the underlying production function is linear—hence the shape of the func- 
tion is determined by Equation (3-2). However, the structure of the production 
process involves interaction among the outputs—a sort of feedback from one 
output to another. For example, achievement may be affected by attitudes, 
while attitudes might also be affected by achievement. In addition, attitude to- 
ward oneself might be affected by one's attitude toward school and society. 
Hence our model allows for such interactions, whether directly or indirectly, 
by specifying a simultaneous-equation system. 

Consider n educational outputs, Q1, Q5, ..., Qn, К school inputs, X1, X5, 
++, Жр, and m nonschool inputs, Z1, Z5, ..., Zy,. Then a generalized system 


of equations describing the educational production process would have the fol- 
fowing form: 


Qi =F, (05.0... ...0,:X,.35,.. Хи, Zo. 
0,51,(01,0.....0,Х,,Х,....,Х21,2,,...,2 


(6-1) 
0,57. (0,,0,,... „О о Жу» Ху... „Хи 2),2,.. Zn ity) 


where the и% denote stochasitc error terms. The output variables (the Q’s) are 
considered to be endogenous variables and the input variables (the Х% and the 
275) exogenous in this system. , 

The equation system must be reduced to a statistically estimable model. 
Some simplification of that System can be achieved through a priori examination 
of the equations. For example, it might be argued that vocational development 
is entirely independent of achievement in verbal skills, implying that some of 
the outputs in each of the equations are likely to have a coefficient that should 
not differ significantly from zero. Similarly, not every input in either the school 
or nonschool variable sets is relevant in each of the equations. In addition, since 
the number of observations is only 53, the number of independent (explanatory) 
variables in any equation is obviously restricted. Furthermore, if it is desired to 
obtain reliable coefficients for the manipulative input variables, an effort must 
be made to reduce the degree of multicolinearity in the data set. 

Several approaches may be followed to overcome these problems. One would 
be to select variables for each equation on the basis of their contribution to ex- 
plaining the output variance. In this method, one wo: 
atory variables to the equation until the additio: 
determination) is less than a prespecified amount 
arbitrarily, or, alternatively, 


uld continue adding explan- 
n to R? (the coefficient of 
- This amount might be set 
one could terminate the addition of variables when 
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the difference between the R? derived when the new variable is added and the 
R? derived before the variable was added is not statistically significant. 

Another alternative would be to employ principal components or factor 
analysis to derive a set of new variables from the original input set. The new set 
of variables would contain fewer factors representing most of the variation in 
the original data set, thus increasing the number of degrees of freedom and the 
reliability of the coefficient estimates. However, the new factors so produced are 
usually difficult to interpret, so that the use of factor or principal components 
analysis is obviously limited. 

A third possibility would be to combine a priori specification with factor 
analysis. For example, if one wishes to examine the effect of various manipula- 
tive variables on educational output, it would be necessary to express these 
factors in their original units. However, there is no need to specify in the equa- 
tion all (or some subset of) the vectors of environmental and nonmanipulative 
School inputs. Instead, principal components of the latter two groups may be 
computed and entered in the equation along with those manipulative variables 
that are thought to belong in the equation a priori. 

А combination of these possibilities has been employed to derive a specifica- 
tion for the simultaneous-equation system. The specification of the full model is 
provided in Table 6-3 and described more fully in the following paragraphs. 


Specifying the Endogenous (Output) Variables 
Each of the twelve equations contains a number of both endogenous and e 


Benous variables. The choice of endogenous variables in the twelve equations 
Was influenced by (1) the degree of (zero order) correlation among the relevant 
Outputs, and (2) a priori analysis. The a priori analysis was used mainly to reduce 
the number of endogenous variables in each equation. The degree of correlation 
Was taken from a previous study of the Pennsylvania data by Donaldson (1971), 
based upon an earlier PDE sample. In summary, then, endogenous variables were 
Chosen in a given equation when they appeared to have relatively high correla- 
tions with the respective dependent variable—provided, however, that an a priori 


argument could support their inclusion in the model. 


XO- 


Specifying the Set of Exogenous Variables | : 
The job of specifying the exogenous set was far more complicated. The main 
Constraint was the lack of degrees of freedom. In addition, the cpm was 
influenced by the desire to investigate as many of the instrument (manipu- 
lative) variables as possible. 
57), рр. 70-74, cited іп Тоһпвіоп (1972), 


i jen a suggestion is made by Kendall (19 
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Table 6-3. Simultaneous—Equations Model 


Equation/Output 


Endogenous Variables 


Exogenous Variables 


1. Goal I 


2. Goal II 


3. боз! Ш-у 


4. Goal III-m 


5. Goal IV 


6. Goal V 


7. Goal VI 


8. Goal VII-p 


9. Goal УП-о 


10. Goal VII 


11. Goal IX 


12. Goal X 


Goal Ш-у, Goal Ш-т Goal IV, 
Goal VI, Goal VII-p, Goal VIII, 
Goal IX 


Goal Ш-у, Goal Ш-т 


Goal I, Goal II, Goal Ш-т 
Goal VI, Goal VIII 


Goal I, Goal II, Goal Ш-у 
Goal VI, Goal VIII 


Goal I, Goal V, Goal VI, 
Goal IX 


Goal IV, Goal VI, Goal VII-o 
Goal VIII, Goal IX 


Goal I, Goal Ш-у, Goal III-m 
Goal IV, Goal V, Goal УП-о, 
Goal VIII, Goal IX 


Goal I, Goal VII-o, Goal VIII, 
Goal IX, Goal X 


Goal V, Goal VI, Goal VII-p 


Goal I, Goal Ш-у, Goal Шет 
Goal V, Goal VI, Goal VIEp 
Goal IX 


Goal I, Goal IV, Goal NS 


Goal VI, Goal VII-p, Goal УШ, 
Goal X 


Goal УП-р, Goal IX 


TEDUC, EFFORT, GUIDANCE, 
TLOD, CSIZ AEE, AMAN, AXMAN, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


TCOLLEGE, DISCREP, TSALARY, 
EFFORT, ADA, TLOD, CSIZ, AEE, 
BRAT, PSUP. SEFAC 1, SEFAC 2, 
SEFAC 3, SEFAC 4 


TEXPER, STAFFP, ADA, CUG, 
TLOD, AEE, AMAN, AXMAN, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


CUG, PRCO, TLOD, AEE, AXMAN, 
PSUP, SEFAC 1, SEFAC 2, SEFAC 
3, SEFAC 4 


LIBRAKY, TPPOS, TSATISF, 
TSTABL, TSALARY, AEE, BRAT, 
АХМАМ, SFRAT, SEFAC 1, 
SEFAC 2, SEFAC 3, SEFAC 4 


LIBRARY, TCOLLEGE, GUID- 
ANCE, TLOCALE, ADA, CUG, 
TLOD, CSIZ, AMAN, AXMAN, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


TSALARY, CUG, TLOD, AEE, 
BRAT, AXMAN, SFRAT, PSUP, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


TSALARY, PRCO, SFRAT, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


TSTABL, TSALARY, TEDUC, 
TLOD, CSIZ, BRAT, AXMAN, PSUP, 
SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


TMEDUC, REACTL, TSALARY, 
TEXPER, CUG, PRCO, TLOD, 
CSIZ, AXMAN, SEFAC 1, 

SEF AC 2, SEFAC 3, SEFAC 4 


TCOLLEGE, RECIDEA, TSALARY, 
CUG, TLOD, SFRAT, ADA, 

SEFAC 1, SEFAC 2, SEFAC 3, 
SEFAC 4 


GUIDANCE, BCOKSP, CLPRACT, 
TSATISF, TCAREER, INNOVATE, 
ADA, CUG, TLOD, CSIZ, AMAN, 
PSUP, SEFAC 1, SEFAC 2, 

SEFAC 3, SEFAC 4 
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P ы, of the focus on instrument variables, it was decided to utilize Ken- 
een (cited above) and employ principal components analysis to 
rge number of potentially relevant inputs into a small set of factors 

We chose to use only four factors, which together explain in excess of 70 e 
d the variation in the original variable set. As noted earlier, the four factors 
vinnm by SEFAC 1 through SEFAC 4. The variables from which these 

were drawn are briefly described in Table 6-4. 
For the remaining exogenous variables, the step-up, ordinary least squares 


Table 6-4. Variables Included in the Four Socioeconomic Factors 


Acronym Definition 

SEX Sex of student (1 = male, 2 = female) 

RACE Race of student (1 = “other,” 2 = black, 3 = Puerto Rican, 4 = Ameri- 
can Indian, 5 = white, 6 = Oriental) 

ATTEND The number of days a student was absent in the past school year 

Focc The student’s father’s education (based on a weighting from 0 to 96 


jon of education needed to secure the 
derived from the occupation) 
Index is similar to the one used for 


according to a combinat 
occupation and income 


мосс The student's mother's occupation. 
А FOCC, and computed for mothers who were gainfully employed 
CTMW Percentage of mothers working 
F 7 
AMSES Family socioeconomic status, a composite of MOCC and FOCC for 
the school 
MORESB Mores—boys: student's perception of the single best way for a boy to 
be important or looked up to by other students in his school 
MORESG Mores- girls: similar to MORESB 
VALUES Student's assessment to that quality which was most important to 


him (her) personally regardless of what others may choose; scales 
used for MORESB and MORESG were used here, too 
SUBSIDY State instructional subsidy per pupil in weighted average daily member- 
ship paid to the school district 
LOCATION Type of community in which the student lives (1 = open country, 
2 = city over 500,000, 3 = town less than 10,000, 4 = city 100,000- 
500,000, 5 = city 10,000-100,000, 6 7 suburb of city 10,000— 
100,000, 7 = suburb of city 100,000— 500,000, 8 = suburb of 
city over 500,000) 


1 
NTERRAC Whether or not students ca 
different from their own in 


ntact with students of a race 


me in со 
ool activities (1 = no, 


their classes or sch 


2 = yes) 

HOUSING Percentage of various types of housing units in the area served by the 
school (1 = low rental apartments, 2 = low cost homes, 3 = moderate 
rental apartments, 4 = moderate priced homes, 5 = high rental 
apartments, 6 = expensive private homes) 


5 " 
ource: Adapted from Russell (1971), pP- 5-7» and 15-18. 
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regression process, as used by Kuhns with the same data, formed the initial basis 
for the specification. All exogenous variables contributing a minimum of one 
percentage point to R2 were allowed to enter (or reenter) the equation. The 
final equation was chosen when no changes in the equation could increase R? by 
at least .01. 

Not all the variables so chosen by Kuhns were included in the present model, 
however. First, some of the variables chosen by Kuhns appear to represent edu- 
cational output more than input. For example, there is the variable HOLDING— 
the inverse of the dropout rate—which is clearly more an output than an input. 
Furthermore, some of the variables in the Kuhns model are clearly not inde- 
pendent of one another. For example, two measures of school size are used— 
enrollment and ADA. Since the correlation between the two is extremely high, 
the two variables essentially serve as proxies for a single input, and inclusion 
of both in any single equation only serves to distort the reliability of the re- 
Spective coefficients. 

It is quite obvious that the specification employed here is far from ideal, 
and would probably invite some criticisms. What should be kept in mind, how- 
ever, is that first, our survey of the literature failed in general to provide con- 
sistent findings that would suggest the inclusion of certain variables, a priori. 
In addition, there is very little prior empirical information on the relationship 
between the outputs (excluding achievement) and the set of inputs used here. 
And finally, that what is presented here should not be considered as a final spe- 


cification but rather as one plausible specification of the simulta: 


neous-equation 
system. 


REGRESSION RESULTS 


An inspection of Table 6-3 would indicate that the model satisfies the neces- 
sary (though not necessarily sufficient) conditions for identification. In fact it is 
overidentified. This is based on the popular counting rule, which requires that 
the number of exogenous variables excluded from each equation must be equal 
to or exceed the number of endogenous variables included in the respective 
equations less one. In consequence, we can estimate the coefficients in the 
twelve equations by employing the widely used two stage least squares (TSLS) 
procedure d 


°For example, if five outputs (endo; 


* genous variables) are inclu 
the maximum number of exogenous 


exogenous variables in the entire equati n set. See John- 
ston (1972), p. 359. aie. 


The issues of identification and estimation regarding systems of equations are treated 
adequately in numerous econometric text books. Excellent analyses may be found in Hu 
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The TSLS procedure provides estimates of the structural coefficients includ- 
ing both endogenous and exogenous variables. The structural coefficients of the 
exogenous variables, however, provide only a partial picture. The full effect of 
any input on a given output also includes the effect of that input on other out- 
puts in the system, so long as the various outprts are not statistically indepen- 
dent. To obtain measures of the full contribution of the exogenous variables to 
each of the outputs, the reduced form equations must be estimated. The reduced 
form coefficients are, essentially, the solutions of the system of twelve equations 
in twelve unknowns, the exogenous variables being treated as givens. 

The analysis in this section will focus on the results pertaining to the manipu- 
lative variables. The results will be discussed in the context of the structural 
coefficients, the reduced form coefficients derived therefrom, and reduced form 
coefficients based on the use of ordinary least squares (OLS) analysis, in which 
the entire set of exogenous variables is regressed separately on each of the twelve 
outputs. The major focus will be centered on the reduced form coefficients. 

The standard errors of the reduced form coefficients were estimated using а 
technique described by Theil (1961, p. 342). These are known as asymptotic 
Standard errors, implying that we know very little about their small sample 
properties, However, Goldberger suggests that “hypothesis testing and interval 
estimation may be carried out by the standard procedures” (Goldberger, 1964, 
р. 371). Readers wishing a more detailed description of the results will find ad- 
ditional information in Appendix Table А-5. The table provides all the struc- 
tural and reduced form coefficients for the simultaneous system, as well as the 


OLS coefficients described above. 


Self Concept | | : 
The structural equation for Goal I includes seven manipulative variab 


тау be observed from Table 6-5. А casual comparison of the structural and 
reduced form coefficients indicates that the latter are, with one exception 
(AEE), greater in absolute value. This is not surprising, 
ents only describe a partial effect of the inputs on Self Concept. | 
Among the structural coefficients there is only one significant pan 
AMAN. Moreover, the negative sign is puzzling, since a simple a priori нч 
Would suggest a positive sign, ceteris paribus. On the other hand, the re uce 
form coefficients indicate an increased role for the instrument variables, despite 
the fact that AMAN is still negative, and that its coefficient is even larget in 
absolute value. The three variables whose coefficients appear to be significantly 


les, as 


as the structural coeffici- 


iri роп involving a minimum of mathematics— 
ond J (ашыгы йн aah КЕЗ? б: mathematically inclined readers. 


and Johnston (1972), Chapters 12 and 13, А 
dvance eec ui ze be found in Goldberger (1964) and Theil (1961). 
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Table 6—5. Production Function Estimates for Manipulative Inputs — Goal I 
(Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TEDUC 0.508 0.904 0.056 
(0.475) (0.764) (1.166) 
GUIDANCE 57.389 110.3 1130.148 
(298.007) (512.1) (569.182) 
TLOD -0.046 -0.307 -0.233 
(0.082) (0.096) (0.154) 
CSIZ -0.008 -0.014 0.210 
(0.027) (0.041) (0.086) 
AEE -0.011 -0.007 -0.014 
(0.007) (0.010) (0.015) 
AMAN 0.042 0.265 0.148 
(0.094) (0.127) (0.147) 
AXMAN -0.121 -0.216 -0.131 
(0.058) (0.076) (0.134) 


different from zero are TLOD, AMAN, and AXMAN. Taking TLOD as an ex- 
ample, a no-nonsense interpretation of the results would suggest that for each 
one hour increase in teaching load, the score on Self Concept is likely to de- 
crease by approximately three-tenths of a point. Although this seems a small 
reduction in the Self Concept score relative to its mean, note that the standard 
deviation of Goal I is only 1.38, so a decrease of one hour in TLOD will con- 
tribute to a reduction in Goal I greater than 22 percent of the standard devia- 
tion. Similarly, an increase in AMAN of one man year is likely to contribute to 
an increase of 0.266 in the Self Concept score, other things being equal. 

We note that the OLS estimates are considerably different from both the 
structural and reduced form coefficients, GUIDANCE has a coefficient of almost 
ten times that of the reduced form coefficient, while the coefficient of CSIZ is 
both positive and Statistically significant. Some of these differences, moreover, 
are also statistically significant. If the specification of the model is accepted, 
then the OLS technique appears to Provide at least some biased coefficients. 


Understanding Others 


None of the coefficients in Table 6-6 is significant at the 5 percent level for a 
two-tailed ¢ test. The coefficient with the largest ғ ratio is the one for BRAT. Al- 


though the sign of the coefficient is consistent with expectation, the results of 
this equation are clearly disappointing. 
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Table 6-6. Production Function Estimates for Manipulative Inputs — Goal 11 
(Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TSALARY 0.0002 0.0002 0.001 
(0.0003) (0.0003) (0.001) 
TLOD 0.157 0.141 0.002 
(0.100) (0.091) (0.173) 
CSIZ -0.040 -0.040 0.016 
(0.030) (0.030) (0.097) 
ABE 0.010 0.011 0.015 
(0.010) (0.010) (0.017) 
BRAT -1.161 -1.170 -2.108 
(0.668) (0.662) (1.114) 
PSUP -0.001 -0.001 0.005 
(0.002) (0.002) (0.003) 
Verbal Skills 


re of particular interest (as are the results for 
the next equation) because of the focus that has been placed upon achievement 
as the most important—if not the sole—educational output. The results, Te 
ported in Table 6-7, provide both positive and negative conclusions. Beginning 
with the latter, teachers’ salaries do not appear to be significant here, unlike re- 


for Manipulative Inputs — Goal 
Parentheses, Standard Error) 


The results for this equation a 


Table 6—7. Production Function Estimates 
Ш-у (Partial Regression Coefficients and, in 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TSALARY -0.008 0.0002 0.001 
(0.036) (0.0002) (0.001) 
-0.027 
Suc -0.008 -0.039 
? 1038 
(0.015) (0.022) A m 
2105 -0.131 -0.245 -0. 
(6.067) (0.072) (0.153) 
0.006 
ABE 0.012 0.017 0015) 
(0.005) (0.007) 
t 0.167 
na Mee uc (0.134) 
(0.052) (0.079) 
' -0.012 
AXMAN -0.049 -0.113 ЖШ 
(0.043) (0.056) 
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sults obtained by many investigators. On the other hand, the coefficients of 
TLOD, AEE, and AMAN are both significant and have the expected signs. The 
same cannot be said, however, of CUG and AXMAN, which consistently display 
unexpected negative signs. Regarding CUG, the negative sign might reflect the 
effect of other variables correlated with CUG, such as school size or urban vs. 
rural location. The negative coefficient of AXMAN might be explained on the 
basis of a possible trade-off between auxiliary manpower and instructional or 
other academic staff. It is possible that many educational outputs are not influ- 
enced by the investment in auxiliary personnel, and, if such investment reduces 
funds for other inputs, the total output may be reduced, 


Mathematical Skills 


Table 6-8 provides the results for this output. Out of the six manipulative 
variables included in the Specification, three reduced form coefficients are sta- 
tistically significant: CUG, TLOD, and PSUP. However, only the TLOD co- 
efficient has the expected sign. The negative coefficient for PSUP might be 
explained, again, on the basis of a trade-off argument. For a fixed sum a school 
can hire either paraprofessionals or other inputs, such as teachers’ or administra- 
tors’ services. If the paraprofessionals are not as productive as expected, then 
Schools using fewer paraprofessionals and more of other inputs will have a 
greater output. Our results appear to suggest, therefore, that paraprofessional 
aides are far less productive than what some may have led us to believe. Inci- 


Table 6—8. Production Fun 


ction Estimates for Manipulative Inputs — Goal 
Ш-т (Partial Regression Coe 


fficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs 


Structural Reduced Form OLS 
CUG -0.030 -0.053 -0.069 
(0.021) (0.026) (0.048) 
PRCO -0.115 0.292 3.590 
(1.645) (2.038) (5.867) 
TLOD -0.046 -0.184 -0.137 
(0.083) (0.086) (0.193) 
AEE 0.004 0.012 -0.009 
(0.007) (0.009) (0.019) 
AXMAN -0.005 -0.086 -0.052 
(0.048) (0.066) (0.168) 
PSUP -0.004 -0.005 -0.007 


(0.002) (0.002) (0.004) 
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dentally, as will be seen later, the negative sign for PSUP persists in other equa- 
tions, as is the case for CUG. 


Interest in School 

The results of this equation, reported in Table 6-9, again provide both posi- 
tive and negative conclusions. The positive conclusions indicate that greater 
access to the library and higher average teacher salaries contribute positively to 
interest in schools—results that are consistent with a priori expectations. The 
negative conclusions are equally important, indicating that interest in school 
might not be increased when additional funds are spent on extracurricular activi- 
ties or when overcrowding is avoided. Also, although the reduced form coeffi- 
cient of SFRAT has the expected sign (suggesting that interest in school is 
higher when lower student-to-faculty ratios are maintained), the coefficient is 
not significantly different from zero. 

Three variables not included in the structural model are also significant in 
the reduced form equation: TSTABL, TSATIS, and TLOD. The latter in par- 
ticular is highly significant, indicating the strong influence of this variable 
through the interaction of other outputs with interest in school. 


Citizenship 
| Four ош of seven manipulative variables rep 
tically significant. Further, the signs of the coef 


orted in Table 6-10 are statis- 
ficients of LIBRARY, TLOD, 


for Manipulative Inpust — Goal IV 


Table 6—9. Production Function Estimates ) 
rror 


(Partial Regression Coefficients and, in Parentheses, Standard E 


Simultaneous System 


pits Structural Reduced Form OLS 
LIBRARY 3.260 3.334 
1.489 у 
TS (0.887) (1.191) po 
"АНУ 0.001 0.002 | 
x (0.001) (0.001) pun 
“в -0.017 -0. 
-0.013 oms 
BR (0.016) (0.020) : d 
41.2 -4. 
ы -2.003 1.295 4367 
(1.348) (1.542) 
" 4 -0.020 
ниң A d ee (0.276) 
(0.115) (0.155) 
SERAT -0.031 0.022 
0.0004 i 0.022 
(0.060) (0.074) (0.158) 
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Table 6—10. Production Function Estimates for Manipulative Inputs — Goal V 
(Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
LIBRARY 2.522 5.857 3.039 
(1.167) (2.231) (3.434) 
GUIDANCE -698.117 -506.6 1825.001 
(840.144) (1608.00) (2017.403) 
сос -0.081 -0.319 0.084 
(0.062) (0.116) (0.135) 
тор 0.012 -0.809 -0.572 
(0.222) (0.355) (0.546) 
CSIZ -0.052 -0.110 0.079 
(0.069) (0.130) (0.306) 
AMAN 0.564 1.363 0.476 
(0.189) (0.423) (0.520) 
AXMAN -0.008 -0.246 -0.501 
(0.149) (0.265) (0.475) 


and AMAN are consistent with a priori expectations. Also, the coefficient of 
CSIZ has the expected sign, although it is not statistically significant. We note, 
too, that the reduced form coefficient of TSALARY, not reported in the table 
(see Appendix Table A-5), is positive and significant, reflecting its indirect influ- 
ence on citizenship via the interaction of other outputs with citizenship. 


Health Habits 


Virtually all the manipulative variables for this output, with the exception of 


AEE, have significant coefficients—although the signs of CUG, AMAN, and 
PSUP* are in the unexpected direction 


these variables)—as may be seen in Та 
particularly interesting: a one standard 
crease in overcrowding) will increase th 
equal to almost 20 percent of a one 
output. Similar effects can also be calc 
also increase the score of health habit: 


(see, however, our earlier comments on 
ble 6-11. The effect of overcrowding is 
deviation increase in BRAT (ї.е., an in- 
€ health habits score by 0.543, which is 
Standard deviation in the health habits 
ulated for TLOD and SFRAT. One could 
$ through changes in teacher salaries. To 


» Which is slightly more than two 
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Table 6—11. Production Function Estimates for Manipulative Inputs — Goal 
VI (Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TSALARY -0.001 0.002 -0.001 
(0.001) (0.001) (0.001) 
CUG -0.075 -0.133 -0.044 
(0.047) (0.048) (0.074) 
TLOD -0.330 -0.566 -0.608 
(0.168) (0.173) (0.298) 
AEE 0.021 0.014 0.018 
(0.016) (0.015) (0.030) 
BRAT 1.824 2.361 0.226 
(1.378) (1.229) (1.920) 
AXMAN -0.122 -0.213 -0.286 
(0.114) (0.110) (0.259) 
SFRAT -0.093 -0.119 -0.097 
(0.051) (0.051) (0.149) 
PSUP -0.011 -0.012 -0.008 
(0.005) (0.004) (0.006) 


Creative Potential 
Two out of the three variables included in the structural model and reported 


in Table 6-12 are significant: TSALARY and PRCO. (In the structural equation 
the two are PRCO and SFRAT.) The sign of PRCO is positive, suggesting that 
Breater diversity of subject matter assignment among the teachers contributes to 
development of creative potential in students. The highly significant coefficient 
for TSALARY is suggestive of the role teachers play in enhancing creative 
potential. 


mates for Manipulative Inputs — Goal 


Table 6—12. Production Function Esti 
d, in Parentheses, Standard Error) 


VII-p (Partial Regression Coefficients an 


Simultaneous System 


Inputs Structural Reduced Form OLS. 
ISA 0.001 0.001 
и ditm (0.0004) (0.001) 
PREO 3.680 5.658 2.067 
(1.615) (2.278) ped 
SERAT 0.056 0.056 | 
(0.020) (0.031) (0.081) 
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Table 6—13. Production Function Estimates for Manipulative Inputs — Goal 
VIl-o (Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TSALARY 0.002 0.002 0.002 
(0.001) (0.001) (0.002) 
TEDUC -2.426 -2.604 -4.041 
(1.672) (1.833) (3.568) 
TLOD 0.103 0.078 0.478 
(0.229) (0.245) (0.471) 
CSIZ 0.063 0.083 0.197 
(0.080) (0.084) (0.265) 
BRAT -5.959 -5.798 -2.063 
(1.844) (1.829) (3.037) 
AXMAN -0.265 -0.293 0.464 
(0.151) (0.163) (0.411) 
PSUP 0.007 0.006 -0.003 
(0.006) (0.006) (0.010) 


Creativity Output 

The results for this output are displayed in Table 6-13, indicating only two 
significant inputs: TSALARY and BRAT. The sign of BRAT implies that in- 
creased creative productivity is associated with а lower ratio of enrollment to 
building capacity—that is, when buildings are less crowded. Although the coeffi- 
cient of TEDUC is not statistically significant, its negative sign suggests the hy- 
pothesis that teachers who on the average obtain more educational preparation 
are likely to focus more on academic achievement than on creative output. 


Vocational Development 


Four out of the seven manipulative variables reported in Table 6-14 are sig- 
nificant: TSALARY, CUG, PRCO, and TLOD. The negative coefficient of CUG 
is, again, somewhat puzzling (note, however, our earlier comments). TSALARY 
and TLOD continue to show a consistent impact on output, whereas the positive 
coefficient of PRCO again indicates that diversity in subject matter assignment 
might be an advantage in this case rather than a disadvantage, as one might have 
expected on the basis of the application of a finer division of labor and increased 
teacher specialization. The negative coefficient of TEXPER is interesting, al- 
though it is not significantly different from zero, at the 5 percent level, for a 


two-tailed test. In addition, the reduced form coefficient of AMAN, not in- 
cluded in the structural model, is significantly positive. 
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e 6-14. Production Function Estimates for Manipulative Inputs — Goal 
ПІ (Partial Regression Coefficients and, in Parentheses, Standard Error) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
TSALARY 0.0003 0.001 0.001 
(0.0002) (0.0002) (0.0004) 
TEXPER -0.064 -0.099 -0.075 
(0.038) (0.056) (0.099) 
сис -0.025 -0.059 -0.029 
(0.010) (0.019) (0.024) 
PRCO 3.805 5.169 2.589 
(0.891) (1.421) (2.947) 
TLOD -0.072 -0.233 -0.195 
(0.040) (0.060) (0.097) 
Csiz 0.007 -0.002 0.117 
(0.015) (0.024) (0.054) 
AXMAN 0.023 -0.075 -0.081 
(0.026) (0.044) (0.084) 


Appreciation of Human Accomplishments 
Table 6-15 has the results for this outpu 
have significant coefficients: TSALARY, CUG, and TLOD. The results here are 
similar to results discussed earlier for the same variables. The coefficient of 
SFRAT is not significant but has the expected sign. We also note that the coef- 
ficient of AMAN, again not included in the structural model, is positive and sig- 


nificant in the reduced form equation. 


t. Three out of the four variables 


stimates for Manipulative Inputs — Goal 


Table 6—15. Production Function E 
d, in Parentheses, Standard Errors) 


ІХ (Partial Regression Coefficients ап 


Simultaneous System 


Mid Structural Reduced Form OLS 
TSALARY 0.001 0.002 -0.0001 
(0.001) (0.001) (0.002) 
n E m m 
ini ол, оё, 286 
= -0.105 
- Eo 2002, auus 
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Preparation for Change 

The final equation, with manipulative coefficients summarized in Table 6-16, 
contains nine variables, six of which have statistically significant coefficients: 
CLPRACT, GUIDANCE, INNOVATE, CUG, TLOD, and AMAN. An examina- 
tion of the full reduced form equation indicates that TSALARY is also positive 
and significant. 

Of interest here are the variables CLPRACT, GUIDANCE, and INNOVATE. 
It appears that the extent to which schools employ innovative practices has op- 
posite implications on preparation for change depending on whose perception 
we rely. Taking teachers? perception, the effect is negative (CLPRACT); taking 
the administration's viewpoint, the effect is positive (INNOVATE). However, 
since the zero order correlation between INNOVATE and CLPRACT is only 
0.10 (with 53 Observations), the two variables clearly serve as proxies for dif- 
ferent inputs, and thus the opposite signs should not be too surprising. What 
is important to note is the fact that use of innovative techniques appears to have 
some impact on this output. The choice of educational methodologies, more- 
over, is up to the school administration, and changes in methodology might be 
attained at a very little resource cost to the school district. 


Table 6—16. Production Function Estimates for Manipulative Inputs — Goal X 
(Partial Regression Coefficients and, in Parentheses, Standard Errors) 


Simultaneous System 


Inputs Structural Reduced Form OLS 
CLPRACT -0.460 -0.536 -0.116 
(0.172) (0.214) (0.380) 
BOOKSP -0.090 -0.105 -0.518 
(0.074) (0.085) (0.211) 
GUIDANCE 1453.498 1656.0 2325.712 
(472.002) (585.2) (1437.762) 
INNOVATE 0.088 0.103 0.095 
(0.036) (0.042) (0.144) 
CUG -0.169 -0.216 0.052 
(0.041) (0.049) (0.097) 
TLOD -0.231 -0.374 е! 
(0.169) (0.193) (0.389) 
CSIZ 0.037 0.032 0.127 
(0.055) (0.066) (0.218) 
AMAN 0.377 0.538 0.161 
(0.136) (0.193) (0.370) 
PSUP -0.004 -0.006 -0.015 


(0.003) (0.004) (0.008) 
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The positive sign for GUIDANCE indicates the effect of the employment of 
guidance counselors on the formation of attitudes. Unless the set of outputs 
also contains attitudinal measures, the impact of a number of potentially impor- 
tant school inputs may go unnoticed, erroneously concluding that expenditures 
on such inputs should be reduced or eliminated. 

We also note that the coefficient of TSALARY in the reduced form equation 
is significantly positive, despite its exclusion from the structural equation. 


Further Observations 
The general goodness of fit of the model, measured, by the coefficient of 


determination, 82, is generally quite satisfactory for models of this type. While 
] variables contribute a large portion of the 
explanatory power of the model, it is equally beyond question that school re- 
lated factors are also important. While some might be disappointed with the 
results, it cannot be denied that school factors, including a number of manipu- 
lative variables, are statistically significant determinants of output. The results 
confirm our expectation that investment in school resources does matter, and 
that reallocation of resources by the school administrator is almost certain to 
result in increased output per unit of input. 

Nevertheless, it should be reemphasized that additional validation and reaf- 
firmation of the results must be forthcoming before substantial changes in the 
allocation of resources within the school system can be recommended. Of 
course, to the extent that the results confirm what educators would have be- 
lieved on a priori analysis alone, there is no reason to be excessively concerned 
Over the various problems plaguing the model. Results which conflict with ac- 
cepted opinions should be viewed with caution, of course, especially since we 
аге not sure whether each of the inputs employed in the model is a proper proxy 


for the input under study. 

At the very least, our results suggest a num 
cerning the relationship between various inp 
receive further investigation. For example, OUT resu 


relation between PSUP and output. Is this because of err A 
because of intercorrelation with other variables, or perhaps because of the 


trade-off theory suggested above? Or consider the negative sign we consistently 
get for CUG. Is that due to intercorrelation with other variables such as school 
Size (the zero order correlation coefficient between CUG and ADA is E 
n = 53), or is it really true that increasing the breadth of the curriculum я 2 
Tesults in reduced output, as measured by the set of output scores an : ? 
Finally, is the negative sign we find for AXMAN in several equations indicative 
ОҒ some kind of a trade-off between instructional staff and auxiliary manpower, 


it is beyond question that nonschoo 


ber of intriguing hypotheses con- 
uts and outputs, which should 
Its point to a negative сог- 
ors in the variable, 
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or is it simply the result of some statistical artifacts? Such questions may be 
answered satisfactorily only after the model has beeen modified, replicated, and 
retested under various circumstances over time and space. 


APPLICATIONS OF THE SIMULTANEOUS- 
EQUATIONS RESULTS 


In discussing the results of the model, primary attention has been focused on 
the level of significance and sign of the regression coefficients. We have not 
attempted to provide guidance regarding the possible uses of the results. We at- 
tempt to fill the gap in this section. 

A word of caution may be appropriate at the outset. It should be recognized 
that the results reported in this study cannot be accepted uncritically. There are 
problems in the collection of the data, in the reliability of both output and input 
measures, in the considerable intercorrelation that remains in the various equa- 
tions despite efforts to reduce it, and finally in the specification of the model. 
What follows is a description of what could be done with such results once one is 
reasonably satisfied that both the data and the underlying model are sound. 


Internal Reallocation of Resources 

School principals could, in principle, be given sufficient flexibility to reallo- 
cate resources within their schools, subject to some constraints, so long as total 
expenditures remain fixed. For example, a secondary school principal might be 
Biven an option to choose between the following: (1) hire ten teachers at the 
average salary of $10,000, or (2) hire fifteen teachers at an average salary of 
$6,667. In the first instance the typical teacher might possess greater previous 
experience and/or educational training than would be the case in the second 
option. However, with fifteen teachers, the principal could expand the curricu- 
lum, and/or reduce the teaching load, and 
vided enough classroom space is available). 

Suppose, for example, that a school has an enrollment of 100 pupils and 
offers 200 academic hours per week of instruction. If ten teachers are hired, the 
teacher-pupil ratio would be 0.1 ‚ and the average teaching load would be twenty 
hours per week. If fifteen teachers are hired, the teacher-pupil ratio would be 
0.15, and the teaching load would be only 13.3 hours per week. Suppose further 
that the school principal wishes to increase the students? verbal skills, and that 
the average experience of the two sets of teachers would be identical (the only 
difference between the two sets being the average educational level). From 
Appendix Table А-5 it is seen that the coefficients for the teacher- 


/or reduce the average class size (pro- 


pupil ratio 
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(STAFFP) and teaching load (TLOD), respectively, are 22.359 and -0.245. 
The difference between the two options is given by a reduction in teaching load 
of 6.67 and an increase in the teacher-pupil ratio of 0.05. The total effect is 
given by: 


Change in Verbal Score = 22.359 (0.05) - 0.245 (-6.67) 


LU 


1.12 * 1.63 
2.15 


That is, the replacement of the ten expensive teachers by the fifteen less expen- 
Sive ones would result in an increase in the verbal skills score of 2.75—more than 
à 17 percent increase over the mean score for the 53 Pennsylvania schools. 

It should be noted that no offsetting reductions in the verbal scores are cal- 
culated for the possible effect of the reduction in teacher “quality” (resulting 
from hiring less expensive teachers) on verbal skills. If the reduction in teacher 
quality results from hiring teachers with less experience, then an offsetting re- 
duction is apparently not needed: the coefficient of TEXPER for this equation 
is negative. However, if the reduction in teacher quality is the result of hiring 
teachers with less educational preparation, then some adjustment should be 
made, since the coefficient of TEDUC is positive for this equation. In this case 
We should continue to substitute less expensive teachers for more expensive ones 
30 long as the net expected change in verbal score is positive. 

The results indicate the potential improvements in verbal skills that may be 
reaped by changing the mix of teachers. This is not quite so easy to implement 
as it may seem at first sight, because teacher hiring and firing is often subject to 
Collective bargaining agreements. Furthermore, school principals all too often 
have no decision making latitude in this respect. Nevertheless, the results do indi- 
Cate an area where internal reallocation of resources might enhance the produc- 


tivity of the school system. 
One problem that must be considered in 


Posed change on other outputs. For examp | 
dents’ attitudes, health habits, and vocational development? Consider Goal I: 


Self Concept. Table 6-5 indicates that the reduction in teacher load might, 
again, lead to improvement in self concept; however, a reduction in the average 
educational level of the teachers is likely to result in an opposite effect. Since 
the latter coefficient is not statistically significant (see Appendix Table A-5), 


One might conclude that the overall effect of the proposed change on self con- 
pact of the reduction in 


Сері is probably positive, but the need to assess the im 


this regard is the effect of the pro- 
le, how does the change affect stu- 
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the average educational level of the teachers remains. Moreover, an inspection 
of Table 6-6, for example, reveals that a reduction in the teaching load might 
reduce the score on Goal II: Understanding Others. A similar effect is shown for 
the reduction in salary for several outputs. The implication of all this is that the 
School decision maker must weigh the benefits from a change in one output 
(such as verbal skills) against losses in other outputs (such as understanding 
others). The decision may not be simple or easy to make, but consistent results 
of the type presented here would go a long way in enabling school management 
personnel to make better decisions. 


Other Management Implications 

The results suggest several implications for management that do not require 
either new or realigned resources. For example, the use of innovative practices 
by teachers could enhance output, as could changes in teacher satisfaction and 
values. It is observed that greater use of innovative practices (INNOVATE) and 
greater teacher job satisfaction (TSATISF) are likely to increase the score on 
Goal X: Preparation for a Changing World. Another example is the coefficient of 
REACTL (-0.277) indicating a lower score on Goal VIII: Vocational Develop- 
ment, as more teachers perceive professional recognition to be achieved through 
personal relationships (such as rapport with central office or immediate 
supervisor) rather than quality and quantity of work completed. Finally, the 
results suggest districtwide implications regarding such matters as desirable teacher 
characteristics, use of guidance personnel, auxiliary manpower, extracurricular 
expenditures, paraprofessional support, or library resources. 


Prediction 

The main purpose of the data collection activities of the Division of Educa- 
tional Quality Assessment (DEQA) in the Pennsylvania Department of Educa- 
tion is to enable schools to determine the extent to which they achieve an 


output level consistent with their input levels. If there are п schools in the 
system, then we compute for each school 


Утар ва жар Њој (= 1, п) (6-2) 


where Y; is the predicted level of the output, Y, for the ith school; ag, 41» 
.,d, are the k regression coefficients for the production function of Y taken 
from the reduced form coefficients reported in Appendix Table A-5; and Ху; is 
the level of the jth input observed in the ith school. 
The main thrust of the DEQA analysis is that schools with different input 
levels ought to expect different output levels. Hence Y would depend on the 
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levels of student, community, school, and instructional staff inputs. The School 
Report, sent to participating schools by the DEQA, contains predictions for each 
school for each of the outputs, along with a prediction interval (given by 
FE SEE)! The position of the actual school score (Y) is also noted. To the 
extent that Y is within the prediction interval, the implication is that the school 
is doing approximately as it should. Similarly, if Y is less than Y - SEE, the 
school is apparently less productive than it should be, and some remedial action 
is recommended (Burson, 1972). 


CONCLUDING COMMENTS 


of insights for school management 
hould be quite useful. At the same 
and the analysis are less than ideal, 


The Pennsylvania data provide a number 
personnel. Properly interpreted, the results 5 
time it must be recognized that both the data 
80 that management decisions should not rely exclusively on the data presented 
here. Moreover, the equation systems reported in this chapter provide only par- 
tial information to decision makers. The analysis does not permit an examina- 
tion of the effect of various inputs on the overall level of output. The next 


chapter presents a model that attempts to overcome this difficulty. 


ISEE = standard error of estimate. 


Chapter Seven 


An Output Index: 
Canonical Correlations 


es a limited use of input-output 


The analysis of the preceding chapter provid 
he regression coefficients indicate 


analysis for educational management because t 
the expected change in any one output due to changes in one or more inputs, 
but not in the overall level of educational output. An index of output that takes 
"ito account all the outputs could be used to overcome this problem. In addi- 
Чоп, an overall output index is necessary for a number of applications, including 
ап analysis of economies of scale in secondary schools, and for the development 
Of a teacher salary plan based upon the production function concept. The out- 
Put indexes presented in this chapter are based upon the canonical correlation 
technique а 


CANONICAL CORRELATIONS 


Tis technique of canonical correlation is designed to assess the degree of associ- 
ation between two sets of variables. Let one of these sets be denoted by У), Y2: 
+++, Y, and the second set by ХХ» anA the canonical correlation 
Ра alysis, a canonical correlation coefficient is computed such that the correla- 
tion between the weighted sum of the Y's, given by 


ions for educational input-output analysis is 
E id der the utilization of the technique for 
оп of the methodologies of and 
Hu (1972), John- 


а 
ыл, study that utilized canonical соп | 
еа О That study, however, did no кішіні Ба 
loping an educational output index. Рог * i 
gae on canonical [па нене consult Chow (1964), Hooper (1969), 
n (1972), pp. 331-334; Tintner (1946), and Waugh (1942). 
81 
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and the weighted sum of the X’s, given by 


is maximized. Of interest in the present analysis are not so much the canonical 
correlation coefficients, but rather the weights, w;, which are associated with the 
maximum canonical correlation. 

In the present context the set of the Y's would represent the outputs and the 
set of the Xs the inputs. Thus the w's are the canonical output weights and the 
v's are the respective input weights. To the extent that one could assume that 
outputs are the outcomes of the inputs, the output weights indicate the relative 
importance of each of the outputs as exhibited by the input-output data. This 
may be a product of some conscious management decisions on the part of school 
administrators, or it could result from the interplay of forces beyond the control 
of school administrators (when nonmanipulative inputs are also included in the 
input set). Consequently, it would not be surprising if the weights produced by 
the canonical correlation technique conflict with the weights that some adminis- 
trators believe should be assigned to the outputs. 


Once output weights are obtained, an output index could be computed ac- 
cording to: 


0 = У 20, (7-1) 


where 0% is the output index, and wj? is the squared canonical weight associated 
with the ith output, Q;. Q* could then be computed for each school, and analy- 
ses utilizing such an index may take place. 


OUTPUT INDEXES 


The Pennsylvania data have been utilized to derive a number of output indexes. 
The indexes differ from one another according to the sets of input and output 
variables that are included in the canonical correlation analysis. Table 7-1 pro- 
vides a list of outputs and inputs included in each of the canonical analyses. 

The first and second canonical analyses differ only in that the variable HOLD- 
ING was included in the second, but not in the first, analysis. That variable 
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Table 7- Р : Я 
еы Input and Output Variables Included іп the Canonical Correlation 


Si 
et]. Outputs: Goals I through X (12 outputs) 
Inputs: FAMSES, TSALARY, ADA, CUG, PRCO, TLOD, CSIZ, AEE, BRAT, 
AMAN, AXMAN, SFRAT, PSUP (13 inputs) 


Set 2. 
€t 2. Outputs: Goals 1 through X, and HOLDING (13 outputs) 


Inputs: Same as for Set 1. 
Se 
et 3. Outputs: Goals 1 through X (12 outputs) 
Inputs: Same as for Set 1 plus the following: SEX, LOCATION, RACE, 


LIBRARY, MORESB, MORESG, VALUES, FOCC, MOCC, PCTMW, 
TPPOS, TLOCALE, TCOLLEGE, TSTABL, TMEDUC, REACTL, 
RECIDEA, TCAREER, TSATISF, DISCREP, CLPRACT, TEXPER, 
TEDUC, EFFORT, HOUSING, STAFFP, BOOKSP, GUIDANCE, 
Š INNOVATE (43 inputs) 
*t4. Outputs: Goals I through X (12 outputs) 
Inputs: SEX, INTERRAC, LOCATION, RACE, LIBRARY, COUNSEL, 
MORESB, MORESG, VA LUES, ATTEND, PCTMW, TAGE, TPPOS, 
TLOCALE, TCOLLEGE, TSTABL, TMEDUC, TFOCC, REACTL, 
RECIDEA, TCAREER, TSATISF, DISCREP, CLPRACT, TEXPER, 
TEDUC, TSEX, SUBSIDY, INSEXADM, EFFORT, HOUSING, 
BOOKSP, GUIDANCE, INNOVATE, plus inputs used in Set 1 


(47 inputs) 


Glossary. Additional information 


Note; Е ex 
е: For a brief description of the acronyms consult the 
also Russell (1971) or 


is provided in T: н 
Kuhns mra 6-4 аға Appendix Tables А-1 through А-4. See 


However, it appears that HOLD- 
stem, indicating the degree to 
nts? The two canonical 
n the resulting output 
ut mix from twelve to 


um included in the input set by Kuhns. 
Nec аш, an output of the educational У 
Analyse пе System has been successful in retaining stude 
lito are intended to provide a comparison betwee! 

s and to indicate the effect of changing the outp 


thirteen variables. 
e test of 


~ third and fourth canonical analyses likewise provide a descriptiv 
D “canonical output weights and resulting output indexes to changes car ym 
ia included in the respective canonical analyses. Thus, p ex 
n and fourth analyses contain the same output sets as the first analysis, 
2n of input variables increases from thirteen to 42 for the third run and to 
E variables for the final run. 
р that the inputs in th | 
axis lui variables. The input set inclu 
а somewhat revised list of variables en 


sis comprise mainly 
was chosen on the 
he single-equation 


e first canonical analy 
ded in the third run 
tering into t 


able € à similar argument, see Burkhead, Fox. and Holland (1967), where a similar vari- 
а5 regarded as an output variable in the analysis. 


84 Input-Output Analysis in Public Education 


Table 7-2. Normalized Canonical Weights for Various Input-Output Sets 


Outputs Set 1 Set2 Set 3 Set 4 
Goal I 0.108 0.130 —0.158 0.080 
Goal II 0.446 0.382 0.097 0.309 
Goal III-v 0.497 0.470 —0.026 0.355 
Goal III-m 0.099 0.145 —0.468 -0.603 
Goal IV 0.241 0.237 0.141 -0.126 
Goal V -0.525 -0.502 -0.444 0.368 
Goal VI -0.156 -0.139 0.090 -0.351 
Goal УП-р 0.068 0.133 0.181 0.108 
Goal VII-o -0.140 -0.091 -0.589 -0.237 
Goal VIII 0.303 0.328 0.212 0.227 
Goal IX 0.068 0.051 0.022 —0.038 
Goal X —0.233 -0.317 0.310 –0.113 
HOLDING a -0.175 а а 


This output was not included іп the output set. 


model developed by Kuhns, whereas the input set included in the final canonical 
analysis contains all the input variables in the data set, with the exception of 
inputs that appear to be proxies for outputs (OCDESIRE, OCEXPECT, POST- 
GRAD, and HOLDING) and inputs that are highly correlated with other inputs 
in the same set. 

The normalized canonical weights for the outputs in each of the analyses 
are reported in Table 7-2.° One is immediately struck by the considerable vari- 
ation among the sets of weights, although the variation between the first and 
second sets is relatively small. It should be noted, however, that the output 
indexes are based on the Squares of the canonical coefficients (2); һепсе, а 
shift in sign but not in absolute value of a weight between successive canonical 
analyses would have no effect on the output index. Moreover, even if the various 
sets of weights are substantially different from one another, it is still possible 
that the output indexes would be highly correlated, so that in practice it would 
not make much difference which.of the sets was chosen for the development 
of the output index. 

Table 7-3 provides an illustration of the manner by which the output index 
is computed from the canonical weights for a particular school (School A). The 
levels of the twelve outputs in that school are given in the first column (Qj). In 
the second column, the squared canonical weights for the fourth canonical anal- 
ysis are provided (м2). The third (rightmost) column represents the contribu- 
tion of each of the outputs to the total output index, measured by the product 
of the squared canonical weight and the respective output level (О; • w,?). The 


©The canonical correlation coefficients are all very close to 1 and are highly significant. 
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Table 7-3. Calculation of an Output Index: An Illustration for “School A" 


Value of Goal Canonical Contribution of Goal to 
Gaur in School A Weight Output Factor in School A 
(Qj (ер) (072) 
t 89.45 1006400 5726 
um 91.05 .095481 8.6935 
ila 15.52 .126025 1.9559 
IV 18.71 .363609 6.8031 
у 94.62 1015876 1.5022 
VI 170.81 .135424 23.1318 
VIL. 122.74 .123201 15.1217 
упр 60.72 :011664 .7082 
vin 137.21 .056169 7.1069 
Ix 84.02 1051529 4.3295 
x 156.47 .001444 .2259 
109.33 .012769 1.3960 


Output Factor = 72.1472 
(хмРор 


overall output level is given by the sum of the contributions of the output fac- 


tors (72.1472 for School A). 

The same procedure was employed t 
Pennsylvania schools on the basis of the 
the consistency of the four output indexes, 
indexes were computed and are reproduced 
Were also correlated with an alternative measure 
Verbal and mathematical scores (Goal III-v + Goal III-m)-to see whether an out- 
Put index based on a number of educational output dimensions differs from the 
traditional measure of basic skills as the sole index of educational output. 


The results of the correlational analysis in Table 7-4 are inconclusive. On the 
t, second, and fourth indexes. 


о derive output levels for each of the 53 
four sets of canonical weights. To test 
the correlations among the four 
in Table 7-4. The output indexes 
of output—the sum of the 


For hand a high correlation is found among the firs d à 
9r reasons not yet clearly understood, the third output index is not as highly 
Table 7-4. Zero Order Correlation Coefficients for Output Indexes 
Sum оў 
4 Verbal and 
Index 1 Index 2 Index 3 Index lera а 
Index 1 
1 1.0000 
na 2 0.9924 1.0000 
istnd 0.6492 0.6449 1.0000 
dun. Е 0.9086 0.9180 0.6372 1.0000 
tnd Math So | 290 1.0000 
and Math Scores 0.4257 0.4576 0.3093 0.7 Я 
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correlated with the others as one would desire if it can be argued that the 
canonical correlation technique provides output indexes that are relatively insen- 
sitive to changes in the set of inputs. Apparently, the addition of 29 input vari- 
ables does change the output index to a considerable extent. However, the 
fourth index, based on 47 input variables, is highly correlated with the first and 
second indexes. Also, the addition of the output HOLDING does not apear to 
affect the output index much (compare indexes 1 and 2). 

In addition, the correlations between the basic skills score and the output 
indexes are relatively low. Even the highest correlation (between the basic skills 
index and the fourth canonical index [r = 0.729] is not very high; a regression 
analysis, with the basic skills score as the independent variable and the fourth 
output index as the dependent variable, indicates that in many cases the pre- 
dicted output is much different from the actual score, so that the rank ordering 
of many schools differs considerably in the two cases. This is exactly why it is 
considered necessary to include other outputs in the analysis, and the results 
reported herein support that position. 


APPLICATIONS INVOLVING THE 
OUTPUT INDEX 


Although there would be numerous opportunities to utilize the output index, 


the present analysis will be confined to two applications with reference to à 
third. 


Economies of Scale 


One area in which considerable research has been undertaken in recent years 
is economies of scale in school operations.* 


The research has been hampered, 
however, by the lack of a comprehensive out 


put measure that must be used in 
the analysis to take account of varying educational qualities. Since the metho- 


dology used to determine scale effects has been developed and fully discussed 
elsewhere, there is no need to repeat it here. 


Suppose that the school is the proper unit for analyzing scale effects. If a 


parabolic relationship is assumed between the cost and size variables, then the 
equation which one seeks to estimate would resemble the following: 


C=a+bS+cS?+dQ+eP+u (7-2) 


dy similar regression analysis for the сапопіс 
and fourth indexes are very good predictors of 
index, 


"See, for example, Cohn (1968), Cohn and Hu (1973), Hettich (1968), Hirsch (1959, 
1960), Riew (1966), and Sabulao and Hickrod (1971). 


al indexes indicates that the first, second, 
one another; this is not true for the third 
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where C is per pupil cost, S is school size, Q is the overall output measure, P is 
an index of the prices that the schools must pay for various services, and u is a 
stochastic error term. It is not necessary to include variables measuring differ- 
ences in socioeconomic conditions because they should not affect the cost of 
education unless educational quality is affected, and educational quality is in- 
cluded as a variable in the equation. P is included to adjust for cost variations 
among schools that are due strictly to differences in cost-of-living conditions 
across the state. 

It has also been argued that a hyperbolic cost function might be more ap- 
propriate (Cohn, 1968, and Cohn and Hu, 1973), in which case the equation 


to be estimated is given by: 

C=a+b(1/S)+cQ+dP+u (1-3) 
h canonical output index was utilized as a 
proxy for Q (because it is based on the largest number of input variables). Al- 
though a comprehensive measure of cost is lacking, information is available on 
the variable INSEXADM (instructional expenditures per pupil in average daily 
membership) for the Pennsylvania data. Use of this variable will certainly limit 
the extent of scale economies shown by the data, but the main purpose of the 
analysis is to illustrate the uses of the output index. Also, average teacher salary 
(TSALARY) has been used to represent P because most instructional costs are 


a direct result of teacher compensation. 
Table 7-5 provides the regression results for equations (7-2) and (1-3). The 


conomies of Scale Model (Dependent 


Empirical Results. The fourth 


Table 7-5, Regression Results for Е 
Variable = INSEXADM) 


Hyperbolic Function 


Explanatory Parabolic Function 

Variables b t b t 
Output (Q) 0.9048 0.195 0.952 0.207 
TSALARY (P) 0.0178 1.547 0.0179 1.538 
ENROLL (5) -0.0168 м 

-NROLL? (S2 700000115 i 

L/ENROLL (I “У 0:00 9550.7617 0.777 
P 0.06 0.056 

Re? 0.00 000 

5 02) 4091 

SEE 41.23 . 


Notes: ђ = partial regression coefficient 
t = ratio 
Re 


SEE 


i freedom 
= coefficient of determination corrected for degrees of 


standard error of estimate 
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empirical results are clearly disappointing. First, none of the regression coeffi- 
cients is statistically significant, and it appears also that all the variables taken 
together do not contribute significantly toward the reduction in the variance 
of INSEXADM.! Despite this, the signs of the coefficients are consistent with a 
priori expectations. Further analysis utilizing both different data and different 
cost measures might prove more rewarding. 


Evaluation of the Contribution 

of Teacher Characteristics 

It is well known that teacher salaries are typically based on the so-called 
single salary schedule, where individual teacher salaries are only a function of 
teaching experience and educational attainment (Cohn, 1972, Chapter 9; Ben- 
son, 1968, Chapter 10). It has been argued elsewhere (Cohn, 1972, pp. 293-297, 
and Cohn, 1973) in favor of a salary program that would take into account those 
factors that appear to influence educational output, so that teachers possessing 
those attributes which, on the average, are shown to enhance educational output 
would be rewarded in proportion to the production function coefficients. For 
example, if a unit of teaching experience is shown to increase output by an 
average amount of 1 percent, a teacher possessing one unit of experience greater 
than the average for the sample under study would be paid an increment in 
salary proportional to the 1 percent improvement in output. Such a salary policy 
would encourage teachers to acquire the attributes for which a monetary reward 
is offered and would serve to reduce the gap between salary payments and rela- 
tive productivity levels of teachers. 

Again, the model proposed here is not intended as the ideal framework for 
measuring the contribution of teacher characteristics but rather serves as an ex- 
ample. The equation to be estimated is given by: 


k 
Q-a * b, TCOLLEGE + b, TEXPER + b, TEDUC + > FACi*u (7-4) 


i=] 


Where Q is the overall output measure; FAC i is the ith factor accounting for 
student, community, school, and teacher inputs not explicitly included in the 
equation; and и is a stochastic error term. The model would assess the contribu- 
tion to total output (О) of educational preparation, teaching experience, and 
type of college from which the teacher graduated. 


fIt should be noted, however, that, except for ENROLL, all of the variables included in 


the model have very low coefficients of variation (0.096 for INSEXADM, 0.068 for TSAL- 
ARY, and 0.018 for the output index). 
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Table 7-6. Regression Results for Teacher Characteristics Model (Dependent 
Variable = Fourth Output Index [Q] ) 


Explanatory Partial Regression 

Variable Coefficient t-Ratio 
TCOLLEGE —0.0582 0.042 
TEXPER 0.0067 0.083 
TEDUC 0.1520 0.229 
FACI 0.2348 1.234 
FAC2 0.1149 0.555 
FAC 3 -0.6956 4.154 
FAC4 -0.2617 1.731 
FACS 0.1829 1.180 
R? 0.405 

Ro? 0.297 

ғ 3.743 

SEE 1.085 


Notes: Re? = coefficient of determination corrected for degrees of freedom 


SEE = standard error of estimate 


Empirical Results. Estimates for the three teacher characteristics were ob- 
tained on the basis of the inclusion of eleven factors and five factors (other than 
those explicitly included in the equation), respectively. Since the addition of six 
factors did not contribute significantly to the explanatory power of the model, 
Only the equation with the five factors (k=5) is reported in Table 7-68 The те- 
Sults indicate that none of the teacher characteristics has a statistically signifi- 
Cant coefficient. This is particularly revealing with regard to TEXPER and 
TED UC, because the results conflict with accepted opinion that experience and 
educational preparation should be rewarded. | 

Note, mai that the output variable has an extremely low rete vd 
Variation (0.018), indicating that the 53 Pennsylvania schools utilized = B 
analysis are quite similar in their educational output. The same 1s also 
TCOLLEGE and TEDUC (with coefficients of variation ћи esed. 
Tespectively), but not of TEXPER (with a coefficient of variation of 0.2 ). E 
Would have to examine additional evidence before the present assumption r : 
garding the contribution to output of educational preparation and experienc 


Could be dismissed. 


Output Inventives in State Aid to Education | 
id formula 

It has been proposed (Cohn, 1974, Chapter 7) lon the мез и и 

Should include incentives for schools to increase their productivi y. Ар 

8 inputs. The five factors account for 


f4 
components О hey represent. 


g incipl 
The five are princip i et t 
factors е e in the input s 


3PProximately 50 percent of the vari: 
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Site for such a framework would be the development of an output index that can 
be shown to be consistent over time. The present analysis provides the nucleus 
for further development and testing of the output index over time and space. 


CONCLUDING COMMENTS 


The development of the output indexes was shown to provide several possi- 
bilities for future application. Although the present empirical results are very 
disappointing, the framework offers new possibilities that should be helpful 
in future research. 

It has been noted that the output indexes are not very sensitive to changes in 
the output set utilized in the canonical correlation analysis. They are, however, 
sensitive to changes in the input set. Also, the output indexes may not be con- 
sistent over time and space, and one would need to study them with great care 
before serious conclusions are drawn. 

Finally, one should not be satisfied with the canonical correlation method as 
the single framework for obtaining output indexes. Alternative approaches 


should be devised and comparisons among the resulting indexes should be made 
to ascertain that the output index used for mana 


gement purposes is as sound as 
can be. 


Chapter Eight 
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The analysis 
Of marginal ань. preceding chapters has been cast almost exclusively in terms 
га the producti ges in the manipulative inputs based upon regression estimates 
escribes the и funation coefficients. Further, the regression analysis only 
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Widely used ments that can be employed to attain 5 
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tin educati 19 by a discussion of how goal programming might be r 
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Models jg cien and a host of other mo 
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LINEAR AND GOAL PROGRAMMING: 
AN INTRODUCTION 


Linear Programming 

Linear programming is a mathematical technique for solving problems in 
which the decision maker wishes to find the course of action that will maximize 
some linear objective function within certain constraints. These constraints are 


also in linear forms. A linear programming problem may be formulated as 
follows: 


Maximize 

CX, +С) xt... t e x, (8-1) 
subject to 

а Хр *45X)*.. tay X, & bi 


21 Хр Fy) X, t... ta, х, < b, 


(8-2) 
4,1Х) tamat. tamnn < 5, 
XpX3,...,x,20 
where x (=1,2,... „т) is the level of activity /, whereas the c's, a’s, and b’s 


are constants. 


In the above formulation, the decision maker is seeking the set of values for 
the x's which will make the objective function in (8-1) a maximum while satis- 
fying all the constraints in (8-2). 

Minimizing the expression (d, хі +d, Xjt...*d, ха) is the same as maxim- 


izing the expression а, хржаух,%...+ d, x,)] or maximizing Cx 


Cy X) +... + Cp Хр) where с, "ud gis, 2, љут) Also, g(x), Хр... X4) 
> b where g(x), Ху, .. . , х,) denotes a function of the n x variables can be 
written as -g(x;, x5, ..., x,) < -b. Therefore, а problem such as: 

Minimize: 


dj x, td x,+...+d,x, 
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subject to 
а XQ tap X) %...%а|,Х, 2b, 


а) X, %аҙ)х)%...%аҙ,Х, > b2 


4 > 
та Хр %4,2Х3%...%4, Xn > bm 


Х,Х,...,Х, >0 


can be put into the format of (8-1) and (8-2) above. 


Goal Programming 

Goal programming is a special type of linear programming. In linear program- 
ming only one goal can be incorporated into the objective function to be maxi- 
mized or minimized. In goal programming more than one goal can be incorpor- 
ated into the objective function. Environmental conditions зиш as resource 
availability are put as constraints. Each goal is set at a level desired by the de- 


cision maker. This level need not be the best possible one, and it may or may 
not be attainable due to the limitations of available resources. Goal programming 
straints and comes closest 


will provide the set of x values that satisfied the constrain’ 2 
to the targets of the decision maker as represented by the stipulated levels s | е 
different goals. The general form of a goal programming problem may be state 


as follows: 

Minimize 

dj +аг+а+ау+...+4 +ди 8-3) 
subject to 

аху варку +.. Жаа, tdr 78 (8-4) 
41Х|%а,,Х,%...%4;, Xn +dy -d7 “8; 


a 
тіХ|%а,2Х)%...Ұ%4 


94 Input-Output Analysis іп Public Education 


4,1 xi * 51,2 *3 а тал Xn = bel (8-5) 

52,1 *1 * 042,2 Жо Жаа” In+2n Xn < была? 

арр ај Хр +, „Каки SD, 

yy у» x, 20 (8-6) 
* e * - + = 

а di ^ 4, ,4; á d а, "т 20 (8-7) 

where 

а; (і-1,2,...,п) = overachievement of goal i, 

d; (i7 1,2,..., n) = underachievement of goal i, 


the a’s and b’s are constants, 
5 (1=1,2,... „п) = target level of goal i, 
and x; (i = 1,... , п) are resource inputs. 


In the above formulation the decision maker is seeking the set of x values that 
will minimize the objective function in (8-3) while satisfying the conditions in 
(8-4) through (8-7). If the decision maker wishes to attain as close as possible 
that particular level of goal i as represented by g;, but is indifferent between 
over- and underachievement of this goal, then both d;* and ар will appear in 
the objective function (8-3). If, however, overachievement of goal i were accep- 
table to him, d;* would not appear in the objective function whereas а)” would. 
Similarly if underachievement of goal i were acceptable, ар would be elimi- 
nated from the objective function. The production function for the m different 
goals are presented in the m equations (8-4) and the resources available are rep- 
resented by the environmental constraints (8-5). 

If the decision maker wishes to attach different priorities to the different 
goals, he may do so by modifying the objective function (8-3). Consider the fol- 
flowing objective function: 
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Minimize 
P * - = 
id, +P} dy + 2Py dy +P, а (8-8) 
where | 
P, and P, are constants and 
Бу >>> P5. 


a ny Ру means that P, is so much larger than P, that no number К can 
jew 2 > P,- In this case, the decision maker gives absolute priority to goal 7. 
* goal 1 has been achieved, goals 2 and 3 are to be met under the criterion 
at goal 2 is twice as important as goal 3. Once again, the presence of both d; * 
си d in the objective function means that the decision maker wants to attain 
ж ats level of goal 1 but is indifferent between over- and underachievement 
goal. Overachievement of goal 2 and underachievement of goal J are ac- 
Septable as indicated by the absence of d5* and 43 in the objective function. 
Nus: programming and goal programming problems can be solved by hand, 
s din Simplex methsd or some variations of it. However, computer programs 
inarily available as an integral part of most computer library packages, 
же programs can handle problems that would be too tedious a task for 
mputation. 


Tea PROGRAMMING IN EDUCATIONAL 
NPUT-OUTPUT ANALYSIS 


s a technique for determining the best 
Education is a process that at- 
varied in nature that, despite 
yet no satisfactory common 


Goal programming is particularly suitable a 
Possible mix of resources in a school system. 
tempts to achieve multiple goals. These goals are so 
Our own efforts, we must conclude that there is as 
basis for measurement." 

The following model is suggeste 
efficient resource allocation in a school system: 


d as a possible solution to the problem of 


ime earnings due to education might be used 
the investment value of education, 
ternal benefits and nonpecuniary 
Holtmann (1968); and 
e is described in detail 


54 M has been argued that the differential lifet 
not Proxy for total output. Such a proxy measures only 

Қалы consumption value, and moreover, it neglects ex 
Pless its of education. For examples of the use of such a proxy see 
Plessner, Fox, and Sanyal (1968). The consumption-investment issu 


i 
^ Cohn (1972), especially Chapters 5 and 7. 
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Minimize 

pes - 8-9) 
dy tdy +...+а; ( 


subject to 
PNE EN 8-10) 
4j 91 581993 вета Же "а езү -6 ( 


> 72% 
#21 Хр #053) +... +аз x -4 +4 


441 арх +... + 


jh (8-11) 
хаг, аг 20 1-12. . 30 

191,2 vnl (8-12) 
where 


d;* = overachievement of goal i, 
d; = underachievement of goal i, 


а are the reduced form coefficients for the manipulative inputs such as we 
derived in Appendix Table А-5 


8; = target level of goal i, 
x, = manipulative input j, 
h, = availability of input j, 


с, = byt diy yo +...+ Bs De тертезеп пр the contribution to goal i of the 
nonmanipulative inputs y fc Ур Where b; аге the reduced form co- 


efficients for the nonmanipulative inputs, also presented in Appendix А-5, 
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1 = number of goals, 


т - number of manipulative inputs 


The right-hand side of each of the goal constraints in (8-10) is the difference 
between the target level of each goal and the contribution to the same goal by 
those nonmanipulative inputs. Constraints in (8-11) are the environmental con- 
straints that represent the resources available. The objective function in (8-9) 
Means that overachievement of each goal is acceptable while trying to achieve 
the different target levels of the goals. 

In the context of our preceding analysis of the Pennsylvania data, some em- 
Pirical analysis could have been presented using the technique of goal program- 
ming. We shall not, however, present any such results here, for two reasons. 
First, the technique of goal programming is particularly suitable for implemen- 
tation at the district level. The regression coefficients presented in Appendix 
Table A-5 would be relevant only to the extent that the production function of 
the various schools are approximately equal. To ascertain the truth of such an 
assertion would require additional knowledge of the schools, which is strictly 
impossible due to the fact that the identification of the individual schools is 
Precluded by the anonymity of the data. Second, there is considerable difference 
between a conclusion that marginal changes in some of the variables are likely 
to increase school productivity and a conclusion that a given vector of manipu- 
lative variables—including, perhaps, substantial changes from the status quo— 
Should be sought. 

What we are saying, in effect, is that whereas the goal programming technique 
is quite powerful and extremely useful in the present context, we are not certain 
that the reliability and accuracy of the production function estimates is such 
that large, finite changes in the manipulative variables should be made on this 
basis. It is clear, however, that consistent validation and replication of the results 
would in the not-too-distant future permit the type of analysis in education that 
is so commonplace in agriculture and other industries. 


CONCLUDING COMMENTS 


When reliable production function coefficients become available, it will be pos- 
sible to employ goal programming in a flexible manner to determine the proper 
mix of manipulative inputs. It would, of course, be necessary to specify the 
desired levels of each goal—a requirement that may be rather distasteful to some 
educational administrators. At the same time, the goal programming approach 
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may be repeated several times to test the sensitivity of the solution vector to 
changes in the program's format. 

It is important to note that the utilization of programming models requires 
knowledge of the educational production function. Unless and until such pro- 
duction functions can be estimated with a reasonable degree of accuracy, our 
ability to formulate and employ sophisticated and powerful input-output tech- 
niques will be forestalled. 

Although we have provided only a skeleton of the goal programming tech- 
nique, it is clear that it holds great promise in the area of educational input- 
output analysis. Empirical work in this area would be of great interest. 


Appendix Tables 
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Table A-4. Additional Inputs 


Variable Name Definition of Variable 
ADA Average daily attendance for building 
CUG Curriculum unit/grade: total number of different subject matters 


available for student registration per grade 


PRCO Coefficient of preparation: the number of different subject matter 
preparations per week per academic teacher 


TLOD Teacher load: average academic teacher instructional hours per week. 


It does not include noncredit classes, i.e., study halls, clubs, etc. 
CSIZ 


AEE 


Class size: average number of students per class 


Extracurricular expenditures/student: 
in the school district for extracurricul 
student 

BRAT Crowding: 

capacity 


total number of dollars spent 
ar activities per secondary 


the ratio of building enrollment to actual state rated 
AMAN Administrative man hours per student: 

school personnel with administrative ге 
assistant principals, attendance Officers 
multiplied by the lengths of the school 
and divided by the numbers of students enrolled in the building 


Auxiliary man hours per student: total number of counselors, 
librarians, audiovisual personnel, etc., in the secondary school, 


multiplied by the lengths of the school day and year, and divided 
by building enrollment 


total number of secondary 
sponsibilities (c.g., principals, 
; department heads, etc.) 

day and the school year, 


AXMAN 


SFRAT 


Student to academic faculty ratio 
PSUP 


Paraprofessionals: sum o 
by all nonprofessional t 
primary function is to 


f the hours worked in the school per week | 
eacher aides including secretaries whose 
aid classroom teachers 


Source: Kuhns (1972), pp. 55-58. 
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ADA 

AEE 
AMAN 
AXMAN 
ATTEND 
BOOKSP 
BRAT 
CLPRACT 
COUNSEL 
CSIZ 

CUG 
DISCREP 


EFFORT 
ENROLL 
EQA 
FAMSES 
ҒОСС 
GOAL I 
GOAL II 
GOAL III-v 
GOAL III-m 
GOAL IV 
GOAL V 
GOAL VI 
GOAL VII-p 


Average daily attendance 

Extracurricular expenditures per pupil 
Administrative manhours per student 

Auxiliary manhours per student 

Number of days students were absent in past year 
Library books per pupil 

Ratio of building enrollment to state rated capacity 
Extent of use of innovation, as perceived by teachers 
Access to guidance staff 

Class size 


Curriculum units per grade | 
Discrepancy between what teachers see as the actual and the ideal 


influences various groups have on school policy 
Property taxes divided by property valuation per pupil 
School enrollment 

Educational quality assessment 

Family socioeconomic status 

Occupation of student's father 

Self concept 

Understanding others 

Verbal basic skills 

Mathematical basic skills 

Interest in school 

Citizenship 

Health habits 


Creativity potential 
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GOAL ҮП-о Creativity output 

GOAL VIII Vocational development 

GOAL IX Appreciation of human accomplishments 

GOAL X Preparation for change 

GUIDANCE Number of guidance counselors per pupil 

HOLDING Inverse of the dropout rate 

HOUSING Index of types of housing in the community 

INNOVATE Extent of use of innovation, as perceived by the administration 
INSEXADM Instructional expenditures per pupil in average daily membership 
INTERRAC Student contact with persons of races different from their own 
LIBRARY Students accessibility to library 


LOCATION Index of type of community in which school is located 
MOCC Occupation of student's mother 
MORESB Boys' mores 


MORESG Girls! mores 
OCDESIRE Occupational desire of students 
OCEXPECT Occupational expectation of students 


OLS Ordinary least squares 

PCTMW Percent of students? mothers working 

PDE Pennsylvania Department of Education 

POSTGRAD Postsecondary education of students graduating in past two years 
PRCO Preparation coefficient for teachers 

PSUP 


Paraprofessional manhours per student 
RACE Students’ race 


REACTL Teachers’ perception of actual characteristics influencing pro- 
fessional recognition 

RECIDEA Teachers’ Perception of ideal characteristics influencing pro- 
fessional recognition 

SEFAC Socioeconomic factor 

SEX Student sex 

SFRAT 


Student to academic faculty ratio 

STAFFP Ratio of instructional Staff to pupils 

SUBSIDY State aid to school district per pupil in average daily membership 
TAGE Teachers’ age 

TCAREER Teachers’ Career aspirations 

TCOLLEGE Index of type of colle 
TEDUC Teacher’s educational 
TEXPER Teachers’ experience 
TFEDUC Education level of teachers’ father 


ge from which teachers received a degree 
Preparation 


TLOCALE 
TLOD 
TMEDUC 
TPPOS 
TSALARY 
TSATISF 
TSEX 
TSTABL 
VALUES 
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Type of town where teachers lived while in high school 
Teaching load per teacher 

Education level of teachers’ mother 

Teachers’ tenure in present position 

Average teachers’ salary 

Teachers’ satisfaction with his role in school 

Teachers’ sex 

Teachers’ locational stability 

Index of students’ personal values 
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